-- Logs begin at Tue 2022-06-07 08:30:34 UTC, end at Tue 2022-06-07 09:54:22 UTC. -- Jun 07 09:19:12.359683 dv-cinder-836996-31-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 07 09:19:12.368238 dv-cinder-836996-31-iscsi devstack@n-api.service[104118]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 07 09:19:12.370699 dv-cinder-836996-31-iscsi devstack@n-api.service[104118]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jun 7 09:19:12 2022] *** Jun 07 09:19:12.370699 dv-cinder-836996-31-iscsi devstack@n-api.service[104118]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 07 09:19:12.370699 dv-cinder-836996-31-iscsi devstack@n-api.service[104118]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 07 09:19:12.370699 dv-cinder-836996-31-iscsi devstack@n-api.service[104118]: nodename: dv-cinder-836996-31-iscsi Jun 07 09:19:12.370699 dv-cinder-836996-31-iscsi devstack@n-api.service[104118]: machine: x86_64 Jun 07 09:19:12.370699 dv-cinder-836996-31-iscsi devstack@n-api.service[104118]: clock source: unix Jun 07 09:19:12.370699 dv-cinder-836996-31-iscsi devstack@n-api.service[104118]: pcre jit disabled Jun 07 09:19:12.370699 dv-cinder-836996-31-iscsi devstack@n-api.service[104118]: detected number of CPU cores: 4 Jun 07 09:19:12.370699 dv-cinder-836996-31-iscsi devstack@n-api.service[104118]: current working directory: / Jun 07 09:19:12.370699 dv-cinder-836996-31-iscsi devstack@n-api.service[104118]: detected binary path: /usr/bin/uwsgi-core Jun 07 09:19:12.370699 dv-cinder-836996-31-iscsi devstack@n-api.service[104118]: your processes number limit is 47680 Jun 07 09:19:12.370699 dv-cinder-836996-31-iscsi devstack@n-api.service[104118]: your memory page size is 4096 bytes Jun 07 09:19:12.370699 dv-cinder-836996-31-iscsi devstack@n-api.service[104118]: detected max file descriptor number: 2048 Jun 07 09:19:12.370699 dv-cinder-836996-31-iscsi devstack@n-api.service[104118]: lock engine: pthread robust mutexes Jun 07 09:19:12.370699 dv-cinder-836996-31-iscsi devstack@n-api.service[104118]: thunder lock: enabled Jun 07 09:19:12.370699 dv-cinder-836996-31-iscsi devstack@n-api.service[104118]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 07 09:19:12.370699 dv-cinder-836996-31-iscsi devstack@n-api.service[104118]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 07 09:19:12.414642 dv-cinder-836996-31-iscsi devstack@n-api.service[104118]: Python main interpreter initialized at 0x55ebba9449c0 Jun 07 09:19:12.414642 dv-cinder-836996-31-iscsi devstack@n-api.service[104118]: python threads support enabled Jun 07 09:19:12.414642 dv-cinder-836996-31-iscsi devstack@n-api.service[104118]: your server socket listen backlog is limited to 100 connections Jun 07 09:19:12.414642 dv-cinder-836996-31-iscsi devstack@n-api.service[104118]: your mercy for graceful operations on workers is 90 seconds Jun 07 09:19:12.414942 dv-cinder-836996-31-iscsi devstack@n-api.service[104118]: mapped 403077 bytes (393 KB) for 2 cores Jun 07 09:19:12.415038 dv-cinder-836996-31-iscsi devstack@n-api.service[104118]: *** Operational MODE: preforking *** Jun 07 09:19:12.415295 dv-cinder-836996-31-iscsi devstack@n-api.service[104118]: *** uWSGI is running in multiple interpreter mode *** Jun 07 09:19:12.415295 dv-cinder-836996-31-iscsi devstack@n-api.service[104118]: spawned uWSGI master process (pid: 104118) Jun 07 09:19:12.415484 dv-cinder-836996-31-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 07 09:19:12.416026 dv-cinder-836996-31-iscsi devstack@n-api.service[104118]: spawned uWSGI worker 1 (pid: 104119, cores: 1) Jun 07 09:19:12.420604 dv-cinder-836996-31-iscsi devstack@n-api.service[104118]: spawned uWSGI worker 2 (pid: 104120, cores: 1) Jun 07 09:19:12.420604 dv-cinder-836996-31-iscsi devstack@n-api.service[104118]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 07 09:19:13.617477 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 07 09:19:13.634586 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 07 09:19:14.326558 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 07 09:19:14.326558 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: from cryptography.utils import int_from_bytes Jun 07 09:19:14.326818 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 07 09:19:14.326818 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: from cryptography.utils import int_from_bytes Jun 07 09:19:14.329613 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 07 09:19:14.329613 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: from cryptography.utils import int_from_bytes Jun 07 09:19:14.329953 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 07 09:19:14.329953 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: from cryptography.utils import int_from_bytes Jun 07 09:19:16.846105 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 07 09:19:16.846659 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 07 09:19:16.846890 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 07 09:19:16.847216 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 07 09:19:16.847466 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 07 09:19:16.847848 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.848169 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.848485 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.848830 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.849155 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.849459 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.849553 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 07 09:19:16.849900 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 07 09:19:16.849974 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.850140 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.850239 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 07 09:19:16.850393 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.850605 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 07 09:19:16.850705 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.850866 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 07 09:19:16.851018 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.851233 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836996-31-iscsi {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.851326 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.851550 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.851647 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.851854 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.851957 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.852160 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.852248 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.852473 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.852561 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.852802 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.852899 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.853119 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.853206 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.853419 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.853505 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.853749 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.853925 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.854039 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.855025 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.855127 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.855207 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836996-31-iscsi {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.855283 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.855283 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.855401 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.855401 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.855514 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.855586 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.855661 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.855833 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.855930 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.856139 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.856232 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.856441 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.856533 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.856783 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.856884 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.857087 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.857317 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.857499 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836996-31-iscsi {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.857631 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.857811 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.857941 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.858119 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.858257 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.858429 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.858595 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.858840 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.858936 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.859148 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.859234 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.859453 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.859546 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.859768 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.859862 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.860084 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.860181 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.860385 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.860489 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.860729 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.860829 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836996-31-iscsi {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.861045 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.861151 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.861357 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.861449 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.861672 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.861758 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.861969 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.862141 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.862272 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.862455 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.862573 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.862765 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.862886 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.863088 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.863182 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.863413 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.863505 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.863702 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.863800 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.864002 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.864095 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.864316 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.864405 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.864651 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.864754 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.864972 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.865069 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.865221 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.865314 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.865471 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.865562 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.865783 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.865870 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.866098 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.866198 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.866399 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.866485 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.866699 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.866797 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.866983 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.867076 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.867286 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.867433 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.867586 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.867683 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.867885 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.867984 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.868185 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.868271 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.868455 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.868540 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.868731 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.868821 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.869054 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.869141 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.869379 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.869499 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.869688 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.869823 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.869995 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.870088 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.870306 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.870402 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.57 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.870612 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.57 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.870698 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.870913 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.871007 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.871218 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.871317 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.871525 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.871611 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.871830 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.871913 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.872389 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.872495 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.872746 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.872837 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.873052 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.873148 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.873350 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.873448 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.873649 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.873735 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.873961 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.874046 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.57 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.874277 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.874371 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.57 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.874574 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.874670 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.874819 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.874912 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.875113 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.875200 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.875409 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.875495 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.875719 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.875811 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.876018 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.876111 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.876316 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.876408 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.876638 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.876727 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.876934 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.877031 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.877233 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.877319 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.877529 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.877614 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.877828 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.877925 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.878124 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.878210 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.878423 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.878510 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.878724 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.878817 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.879019 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.879145 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.879316 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.879461 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.879611 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.879769 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.879919 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.880079 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.880232 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.880382 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.880531 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.880713 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.880853 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.881021 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.881150 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.881330 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.881447 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.881639 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.881757 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.881945 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.882058 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.882257 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.882344 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.882564 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.882657 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.882871 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.882956 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.883175 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.883269 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.883495 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.883582 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.883800 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.883892 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.884098 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.884192 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.884404 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.884488 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.884719 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.884820 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.885018 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.885112 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.885324 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.885417 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.885622 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.885708 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.885919 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.886014 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.886213 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.886301 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.886508 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.886603 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.886803 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.886889 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.887099 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.887187 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.887391 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.887486 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.887685 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.887794 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.887976 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.888065 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.888271 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.888878 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.889126 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.889211 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.889433 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.889523 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.889733 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.889828 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.890033 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.890119 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.890336 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.890421 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.890642 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.890730 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.890948 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.891044 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.891253 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.891340 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.891555 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.891642 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.891858 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.891950 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.892157 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.892244 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.892465 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.892560 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.892817 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.892904 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.893125 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.893209 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.893432 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.893518 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.893738 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.893829 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.894043 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.894137 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:19:16.894347 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.894440 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.894659 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.894744 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.894969 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.895067 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.895289 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.895376 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.895598 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.895683 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.895909 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.896004 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.896220 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.896307 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.896525 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.896628 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.896870 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.896979 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.897190 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.897285 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.897506 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.897592 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.897812 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.897911 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.898121 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.898206 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.898439 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.898526 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.898757 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.898852 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.899071 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.899157 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.899390 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.899484 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.899694 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.899791 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.899996 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.900082 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.900299 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.900393 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.900633 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.900726 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.900960 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.901046 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.901265 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.901362 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.901576 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.901671 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.901880 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.901966 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.902185 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.902278 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.902487 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.902582 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.902791 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.902885 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.903094 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.903188 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.903419 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.903511 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.903724 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.903811 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.904081 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.904770 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.904933 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.905027 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.905249 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.905341 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.905557 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.905656 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.905863 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.905956 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.906166 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.906259 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.906465 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.906559 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.906763 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.906849 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.907061 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.907146 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.907362 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.907449 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.907659 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.907752 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.907972 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.908065 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.908291 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.908379 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.908659 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.908760 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.908923 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.909009 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.909230 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.909325 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.909534 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.909620 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.909838 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.909925 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.910141 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.910228 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.910436 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.910531 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.910740 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.910833 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.911043 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.911130 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.911344 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.911436 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.911657 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.911752 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.911963 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.912049 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.912260 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.912346 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.912575 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.912696 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.912901 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.912988 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.913201 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.913287 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.913508 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.913602 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.913810 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.913895 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.914114 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.914199 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.914415 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.914510 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.914721 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.914855 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.915025 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.915112 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.915333 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.915419 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.915639 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.915726 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.915942 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.916026 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.916263 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.916351 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.916563 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.916709 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.916890 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.916976 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.917205 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.917293 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.917511 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.917596 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.917810 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.917896 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.918113 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.918200 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.918409 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.918495 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.918707 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.918805 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.919003 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.919096 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.919311 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.919397 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.919633 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.919796 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.919942 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.920041 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.920241 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.920327 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.920539 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.920654 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.920864 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.920957 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.921178 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.921265 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.921481 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.921577 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.921781 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.921868 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.922080 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.922165 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.922377 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.922465 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.922703 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.922789 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.923000 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.923085 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.923306 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.923398 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.923611 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.923698 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.923917 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.924010 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.924222 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.924309 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.924529 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.924634 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.924863 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.924947 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.925168 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.925259 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.925471 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.925559 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.925775 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.925869 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.926077 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.926165 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.926390 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.926510 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.926693 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.926789 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.927004 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.927091 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.927305 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.927391 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.927617 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.927712 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.927921 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.928007 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.928233 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.928319 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.928531 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.928662 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.928864 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.928951 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.929181 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.929274 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.929493 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.929580 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.929807 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.929895 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.930120 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.930206 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.930426 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.930513 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.930734 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.930820 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.931037 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.931124 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.931341 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.931429 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.931643 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.931737 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.931947 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.932035 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.932252 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.932338 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.932554 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.932700 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.932891 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.932980 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.933195 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.933289 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.933510 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.933604 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.933813 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.933909 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.934125 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.934219 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.934422 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.934511 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.934730 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.934830 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.935045 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.935166 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.935382 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.935469 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.935686 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.935780 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.935990 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.936084 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.936301 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.936386 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.936632 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.936734 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.936928 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.937015 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.937233 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.937320 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.937533 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.937621 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.937832 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.937919 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.938138 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.938225 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.938445 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.938534 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.938749 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.938843 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.939053 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.939146 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.939360 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.939453 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.939667 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.939760 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.939970 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.940065 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.940268 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.940363 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.940565 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.940713 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.940892 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.940995 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.941197 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.941290 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.941499 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.941591 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.941806 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.941900 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.942118 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.942207 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.942416 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.942504 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.942713 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.942807 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.943022 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.943107 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.943322 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.943407 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.943618 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.943717 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.943916 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.944011 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.944213 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.944306 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.944521 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.944663 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.944862 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.944948 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.945160 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.945282 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.945471 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.945559 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.945783 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.945870 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.946087 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.946174 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.946389 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.946475 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.946691 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.946777 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.946993 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.947145 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.947302 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.947397 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.947608 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.947696 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.947908 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.948067 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.948212 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.948343 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.948514 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.948629 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.948842 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.948942 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.949148 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.949235 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.949462 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.949548 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.949766 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.949868 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.950069 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.950157 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.950369 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.950455 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.950666 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.950760 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.951498 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.951627 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.951810 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.951898 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.952120 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.952370 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.952456 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.952721 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.952811 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.953034 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.953133 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.953350 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.953438 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.953663 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.953749 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.953970 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.954064 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.954280 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.954367 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.954590 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.954684 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.954894 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.954989 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.955202 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.955298 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.955504 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.955597 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.955803 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.956066 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.956163 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.956394 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.956480 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.956720 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.956855 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.957025 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.957122 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.957324 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.957418 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.957628 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.957718 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.957926 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.958014 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.958223 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.958310 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.958519 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.958629 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.958818 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.958939 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.959126 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.959250 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.959424 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.959556 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.959733 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.959860 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.960048 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.960175 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.960346 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.960481 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.960671 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.960816 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.960972 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.961122 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.961269 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.961433 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.961566 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.961736 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.961899 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.962039 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.962196 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.962343 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.962524 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.962647 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.962843 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.962959 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.963178 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.963272 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.963478 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.963566 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.963774 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.963861 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.964090 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.964184 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.964389 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.964478 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.964709 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.964799 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.965006 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.965103 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.965310 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.965398 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.965610 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.965697 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.965906 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.966002 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.966210 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.966297 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.966581 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.966679 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.966888 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.966989 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.967191 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.967277 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.967487 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.967574 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.967789 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.967885 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.968086 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.968173 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.968392 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.968535 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.968732 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.968837 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.969031 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.969118 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.969328 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.969415 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.969634 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.969729 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.969939 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.970026 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.970234 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.970327 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.970536 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.970630 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.970830 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.970917 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.971132 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.971218 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.971426 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.971513 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.971723 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.971809 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.972018 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.972104 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.972321 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.972409 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.972640 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.972746 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.972939 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.973039 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.973255 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.973347 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.973554 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.973646 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.973852 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.973947 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.974147 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.974233 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.974447 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.974532 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.974740 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.974834 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.975034 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.975120 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.975335 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.975422 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.975637 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.975730 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.975944 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.976030 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.976240 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.976326 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.976539 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.976696 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.976859 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.977025 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.977155 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.977357 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.977456 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.977668 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.977761 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.977974 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.978061 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.978284 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.978382 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.978574 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.978660 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.978868 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.978954 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.979160 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.979258 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.979473 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.979560 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.979778 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.979864 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.980072 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.980160 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.980370 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.980456 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.980692 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.980781 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.981025 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.981120 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.981320 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.981406 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.981663 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.981749 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.981956 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.982050 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.982783 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.982870 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.983086 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.983174 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.983386 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.983473 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.983688 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.983774 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.983993 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.984088 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.984287 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.984386 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.984600 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.984688 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.984912 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.985011 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.985214 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.985300 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.985509 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.985596 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.985805 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.985901 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.986117 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.986203 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.986420 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.986507 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.986722 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.986817 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.987035 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.987168 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.987351 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.987438 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.987661 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.987759 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.987956 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.988044 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.988256 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.988343 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.988556 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.988703 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.988881 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.988979 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.989185 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.989272 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.989486 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.989573 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.989787 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.989872 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.990090 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.990177 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.990397 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.990486 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.990701 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.990787 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.991003 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.991091 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.991302 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.991396 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.991607 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.991694 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.991908 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.992004 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.992207 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.992294 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.992513 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.992640 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.992843 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.992945 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.993141 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.993235 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.993443 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.993529 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.993741 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.993837 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.994043 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.994130 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.994338 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.994424 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.994648 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.994742 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.994960 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.995047 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.995267 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.995353 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.995577 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.995664 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.995887 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.995976 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.996192 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.996277 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.996502 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.996608 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.996839 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.996926 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.997391 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.997532 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.997706 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.997907 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.998060 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.998360 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.998447 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.998665 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.998813 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.999089 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.999227 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.999400 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.999534 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.999713 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:16.999837 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.000018 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.000113 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.000328 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.000436 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.000665 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.000767 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.000985 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.001073 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.001301 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.001395 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.001609 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.001698 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.001923 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.002009 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.002239 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.002361 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.002668 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.002794 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.002939 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.003051 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.003239 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.003370 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.003547 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.003660 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.003859 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.003973 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.004186 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.004320 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.004492 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.004626 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.004822 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.004936 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.005128 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.005255 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.005445 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.005559 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.005750 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.005870 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.006052 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.006175 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.006370 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.006484 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.006688 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.006802 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.007473 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.007612 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.007702 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.007803 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.007893 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.007974 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.008053 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.008140 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.008220 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.008370 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.008458 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.008720 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.008812 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.009048 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.009176 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.009354 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.009492 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.009668 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.009796 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.009981 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.010111 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.010308 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.010436 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.010632 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.010719 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.010945 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.011033 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.011261 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.011357 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.011566 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.011738 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.011872 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.011960 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.012188 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.012275 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.012486 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.012598 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.012821 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.012936 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.013125 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.013242 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.013943 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.014074 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.014245 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.014390 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.014543 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.014715 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.014857 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.015043 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.015166 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.015349 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.015478 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.015656 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.015779 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.015968 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.016081 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.016273 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.016387 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.016627 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.016763 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.016923 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.017037 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.017230 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.017345 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.017543 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.017672 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.017842 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.017957 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.018140 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.018231 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.018442 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.018540 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.018747 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.018835 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.019063 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.019159 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.019367 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.019461 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.019689 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.019776 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.019991 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.020084 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.020311 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.020398 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.020653 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.020744 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.020961 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.021048 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.021271 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.021367 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.021579 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.021673 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.021874 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.021967 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.022177 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.022270 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.022482 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.022577 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.022821 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.022917 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.023130 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.023226 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.023435 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.023521 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.023740 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.023837 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.024036 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.024123 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.024332 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.024427 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.024650 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.024753 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.024969 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.025056 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.025269 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.025357 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.025585 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.025685 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.025888 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.025975 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.026187 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.026277 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.026485 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.026580 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.026781 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.026868 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.027114 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.027210 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.027412 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.027508 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.027713 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.027806 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.028021 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.028107 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.028322 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.028418 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.028645 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.028738 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.028964 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.029081 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.029816 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.029906 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.030122 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.030209 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.030445 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.030545 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.030753 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.030840 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.031055 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.031142 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.031361 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.031457 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.031663 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.031757 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.031969 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.032055 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.032273 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.032367 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.032596 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.032696 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.032909 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.032996 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.033220 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.033317 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.033552 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.033751 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.033862 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.034079 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.034175 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.034391 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.034486 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.034702 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.034789 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.035013 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.035110 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.035322 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.035409 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.035632 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.035719 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.035942 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.036039 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.036250 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.036345 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.036556 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.036711 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.036888 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.036993 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.037212 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.037301 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.037527 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.037613 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.037845 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.038064 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.038187 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.038394 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.038482 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.038711 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.038810 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.039025 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.039113 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.039341 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.039428 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.039656 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.039752 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.039974 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.040062 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.040279 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.040365 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.040602 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.040693 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.040924 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.041012 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.041230 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.041315 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.041534 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.041631 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.041838 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.041926 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.042144 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.042240 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.042450 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.042544 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.042755 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.042842 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.043060 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.043157 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.043367 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.043466 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.043674 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.043768 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.043989 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.044086 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.044315 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.044411 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.044682 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.044775 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.044994 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.045089 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.045300 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.045388 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.045609 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.045703 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.045919 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.046115 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.046233 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.046421 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.046548 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.046746 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.046844 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.047064 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.047151 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.047382 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.047479 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.047689 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.047785 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.048000 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.048087 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.048321 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.048407 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.048642 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.048734 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.048948 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.049046 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.049254 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.049386 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.049558 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.049646 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.049856 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.049949 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.050171 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.050428 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.050523 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.050746 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.050833 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.051068 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.051154 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.051373 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.051461 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.051703 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.051895 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.052020 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.052235 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.052330 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.052546 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.052654 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.052888 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.052976 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.053208 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.053312 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.053520 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.053608 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.053820 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.053907 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.054135 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.054223 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.054435 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.054531 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.054734 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.054822 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.055040 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.055128 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.055344 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.055430 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.055642 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.055737 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.055941 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.056171 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.056259 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.056516 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.056637 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.056842 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.056942 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.057145 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.057233 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.057441 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.057528 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.057758 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.057854 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.058057 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.058144 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.058355 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.058449 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.058653 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.058742 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.058956 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.059043 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.059253 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.059347 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.059550 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.059641 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.059849 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.059936 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.060145 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.060251 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.060476 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.060564 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.060803 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.060891 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.061106 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.061205 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.061401 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.061494 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.061703 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.061790 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.062001 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.062100 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.062300 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.062388 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.062606 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.062692 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.062910 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.063006 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.063221 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.063317 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.063514 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.063600 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.063819 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.063918 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.064122 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.064208 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.064424 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.064509 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.064755 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.064855 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.065058 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.065145 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.065366 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.065460 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.065671 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.065759 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.065982 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.066197 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.066292 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.066530 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.066627 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.066848 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.066943 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.067177 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.067265 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.067504 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.067601 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.067805 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.067892 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.068104 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.068196 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.068407 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.068570 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.068752 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.068838 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.069058 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.069153 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.069365 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.069461 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.069670 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.069760 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.069975 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.070061 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.070281 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.070530 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.070619 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.070869 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.070956 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.071172 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.071259 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.071474 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.071567 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.071775 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.071861 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.072078 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.072166 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.072379 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.072466 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.072713 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.072804 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.073022 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.073117 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.073342 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.073428 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.073654 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.073748 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.073962 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.074049 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.074270 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.074357 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.074578 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.074673 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.074881 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.074979 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.075185 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.075273 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.075486 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.075587 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.075789 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.076402 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.076651 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.076756 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.076965 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.077060 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.077270 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.077356 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.077571 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.077666 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.077882 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.077970 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.078222 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.078309 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.078542 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.078675 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.078861 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.078957 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.079160 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.079246 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.079476 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.079563 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.079785 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.079872 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.080087 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.080180 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.080397 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.080492 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.080732 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.080970 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.081062 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.081305 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.081392 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.081639 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.081732 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.081957 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.082051 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.082266 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.082354 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.082574 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.082683 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.082873 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.083000 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.083176 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.083322 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.083487 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.083645 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.083791 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.083957 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.084087 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.084281 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.084369 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.084630 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.084720 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.084948 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.085047 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.085269 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.085356 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.085567 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.085660 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.085866 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.085954 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.086169 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.086264 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.086465 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.086552 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.086762 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.086904 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.087060 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.087148 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.087355 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.087449 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.087651 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.087756 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.087948 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.088046 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.088250 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.088336 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.088546 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.088710 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.088868 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.088965 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.089165 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.089252 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.089461 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.089556 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.089756 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.089843 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.090080 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.090167 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.090383 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.090476 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.090689 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.090828 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.090998 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.091093 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.091301 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.091391 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.092167 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.092264 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.092475 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.092570 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.092806 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.092902 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.093112 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.093199 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.093418 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.093515 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.093729 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.093817 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.094034 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.094121 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.094339 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.094436 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.094643 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.094738 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.094944 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.095030 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.095246 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.095340 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.095549 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.095643 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.095852 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.095938 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.096217 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.096324 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.096490 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.096597 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.096814 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.096914 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.097133 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.097230 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.097443 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.097536 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.097753 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.097840 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.098062 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.098150 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.098365 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.098459 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.098674 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.098798 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.098979 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.099074 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.099284 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.099372 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.099595 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.099754 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.099898 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.099988 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.100203 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.100290 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.100511 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.100662 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.100846 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.100946 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.101164 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.101250 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.101488 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.101583 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.101791 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.101879 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.102113 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.102211 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.102431 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.102527 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.102749 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.102835 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.103064 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.103164 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.103370 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.103460 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.103700 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.103788 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.104007 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.104092 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.104312 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.104407 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.104629 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.104721 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.104872 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 07 09:19:17.104971 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.105248 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.105565 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.105883 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.106211 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.106535 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.106845 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.107208 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.107539 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.107885 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.108202 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.108546 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.108914 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.109233 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.109545 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.109850 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:19:17.110416 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 07 09:19:17.162525 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: INFO dbcounter [None req-b406232d-a8ae-4545-a5e7-5fa22ed5af62 None None] Registered counter for database nova_api Jun 07 09:19:17.168857 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: INFO dbcounter [None req-0c3d0c22-d2ff-47b5-8f15-18e288f1156c None None] Registered counter for database nova_api Jun 07 09:19:17.182676 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG oslo_db.sqlalchemy.engines [None req-b406232d-a8ae-4545-a5e7-5fa22ed5af62 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104119) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 09:19:17.188527 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG oslo_db.sqlalchemy.engines [None req-0c3d0c22-d2ff-47b5-8f15-18e288f1156c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104120) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 09:19:17.189702 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG dbcounter [-] [104119] Writer thread running {{(pid=104119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 09:19:17.194969 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG dbcounter [-] [104120] Writer thread running {{(pid=104120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 09:19:17.245748 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.context [None req-b406232d-a8ae-4545-a5e7-5fa22ed5af62 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),10588278-77f2-4e92-84e1-e5f9671c3564(cell1) {{(pid=104119) load_cells /opt/stack/nova/nova/context.py:464}} Jun 07 09:19:17.251026 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG oslo_concurrency.lockutils [None req-b406232d-a8ae-4545-a5e7-5fa22ed5af62 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:19:17.252354 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.context [None req-0c3d0c22-d2ff-47b5-8f15-18e288f1156c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),10588278-77f2-4e92-84e1-e5f9671c3564(cell1) {{(pid=104120) load_cells /opt/stack/nova/nova/context.py:464}} Jun 07 09:19:17.256979 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG oslo_concurrency.lockutils [None req-b406232d-a8ae-4545-a5e7-5fa22ed5af62 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:19:17.256979 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG oslo_concurrency.lockutils [None req-b406232d-a8ae-4545-a5e7-5fa22ed5af62 None None] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:19:17.256979 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG oslo_concurrency.lockutils [None req-b406232d-a8ae-4545-a5e7-5fa22ed5af62 None None] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:19:17.257396 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG oslo_concurrency.lockutils [None req-0c3d0c22-d2ff-47b5-8f15-18e288f1156c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:19:17.257485 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: INFO dbcounter [None req-b406232d-a8ae-4545-a5e7-5fa22ed5af62 None None] Registered counter for database nova_cell0 Jun 07 09:19:17.258103 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG oslo_concurrency.lockutils [None req-0c3d0c22-d2ff-47b5-8f15-18e288f1156c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:19:17.258899 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG oslo_concurrency.lockutils [None req-0c3d0c22-d2ff-47b5-8f15-18e288f1156c None None] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:19:17.260880 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG oslo_concurrency.lockutils [None req-0c3d0c22-d2ff-47b5-8f15-18e288f1156c None None] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:19:17.261206 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: INFO dbcounter [None req-b406232d-a8ae-4545-a5e7-5fa22ed5af62 None None] Registered counter for database nova_cell1 Jun 07 09:19:17.262863 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: INFO dbcounter [None req-0c3d0c22-d2ff-47b5-8f15-18e288f1156c None None] Registered counter for database nova_cell0 Jun 07 09:19:17.267198 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: INFO dbcounter [None req-0c3d0c22-d2ff-47b5-8f15-18e288f1156c None None] Registered counter for database nova_cell1 Jun 07 09:19:17.269012 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG oslo_db.sqlalchemy.engines [None req-b406232d-a8ae-4545-a5e7-5fa22ed5af62 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104119) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 09:19:17.271290 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG oslo_db.sqlalchemy.engines [None req-b406232d-a8ae-4545-a5e7-5fa22ed5af62 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104119) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 09:19:17.274757 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG oslo_db.sqlalchemy.engines [None req-0c3d0c22-d2ff-47b5-8f15-18e288f1156c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104120) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 09:19:17.276401 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG dbcounter [-] [104119] Writer thread running {{(pid=104119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 09:19:17.276510 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG oslo_db.sqlalchemy.engines [None req-0c3d0c22-d2ff-47b5-8f15-18e288f1156c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104120) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 09:19:17.282099 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG dbcounter [-] [104119] Writer thread running {{(pid=104119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 09:19:17.283046 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG dbcounter [-] [104120] Writer thread running {{(pid=104120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 09:19:17.285170 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG dbcounter [-] [104120] Writer thread running {{(pid=104120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 09:19:17.423730 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: INFO dbcounter [None req-b406232d-a8ae-4545-a5e7-5fa22ed5af62 None None] Registered counter for database nova_cell0 Jun 07 09:19:17.431154 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: INFO dbcounter [None req-0c3d0c22-d2ff-47b5-8f15-18e288f1156c None None] Registered counter for database nova_cell0 Jun 07 09:19:17.432433 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG oslo_db.sqlalchemy.engines [None req-b406232d-a8ae-4545-a5e7-5fa22ed5af62 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104119) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 09:19:17.436843 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG dbcounter [-] [104119] Writer thread running {{(pid=104119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 09:19:17.439644 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG oslo_db.sqlalchemy.engines [None req-0c3d0c22-d2ff-47b5-8f15-18e288f1156c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104120) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 09:19:17.443904 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG dbcounter [-] [104120] Writer thread running {{(pid=104120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 09:19:17.975668 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: WARNING keystonemiddleware.auth_token [None req-b406232d-a8ae-4545-a5e7-5fa22ed5af62 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 07 09:19:17.983006 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: WARNING keystonemiddleware.auth_token [None req-b406232d-a8ae-4545-a5e7-5fa22ed5af62 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 07 09:19:18.002219 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: WARNING keystonemiddleware.auth_token [None req-0c3d0c22-d2ff-47b5-8f15-18e288f1156c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 07 09:19:18.009547 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: WARNING keystonemiddleware.auth_token [None req-0c3d0c22-d2ff-47b5-8f15-18e288f1156c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 07 09:19:18.202920 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: WARNING keystonemiddleware.auth_token [None req-b406232d-a8ae-4545-a5e7-5fa22ed5af62 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 07 09:19:18.208881 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: WARNING keystonemiddleware.auth_token [None req-b406232d-a8ae-4545-a5e7-5fa22ed5af62 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 07 09:19:18.213899 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ebba9449c0 pid: 104119 (default app) Jun 07 09:19:18.217510 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi [None req-b406232d-a8ae-4545-a5e7-5fa22ed5af62 None None] Calling method '>' {{(pid=104119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:19:18.218677 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: INFO nova.api.openstack.requestlog [None req-b406232d-a8ae-4545-a5e7-5fa22ed5af62 None None] 10.222.0.57 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.003260 Jun 07 09:19:18.219084 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: [pid: 104119|app: 0|req: 1/1] 10.222.0.57 () {50 vars in 788 bytes} [Tue Jun 7 09:19:18 2022] GET /compute/v2.1/ => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:19:18.232789 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: WARNING keystonemiddleware.auth_token [None req-0c3d0c22-d2ff-47b5-8f15-18e288f1156c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 07 09:19:18.238708 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: WARNING keystonemiddleware.auth_token [None req-0c3d0c22-d2ff-47b5-8f15-18e288f1156c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 07 09:19:18.243750 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ebba9449c0 pid: 104120 (default app) Jun 07 09:20:38.906083 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi [None req-b406232d-a8ae-4545-a5e7-5fa22ed5af62 None None] Calling method '>' {{(pid=104119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:20:38.912092 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: INFO nova.api.openstack.requestlog [None req-b406232d-a8ae-4545-a5e7-5fa22ed5af62 None None] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Jun 07 09:20:38.912092 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: [pid: 104119|app: 0|req: 2/2] 10.222.0.57 () {54 vars in 930 bytes} [Tue Jun 7 09:20:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:20:38.921274 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG dbcounter [-] [104120] Writing DB stats nova_api:SELECT=3 {{(pid=104120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:20:38.922483 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG dbcounter [-] [104120] Writing DB stats nova_cell1:SELECT=3 {{(pid=104120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:20:38.923367 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG dbcounter [-] [104120] Writing DB stats nova_cell0:SELECT=3 {{(pid=104120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:20:38.924368 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG dbcounter [-] [104120] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:20:39.366933 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi [None req-d658a73b-44dc-4e3b-ae14-77e943180c01 admin admin] Calling method '>' {{(pid=104120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:20:39.396757 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: INFO nova.api.openstack.requestlog [None req-d658a73b-44dc-4e3b-ae14-77e943180c01 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.480928 Jun 07 09:20:39.397295 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: [pid: 104120|app: 0|req: 1/3] 10.222.0.57 () {60 vars in 1291 bytes} [Tue Jun 7 09:20:38 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:20:41.678644 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi [None req-b406232d-a8ae-4545-a5e7-5fa22ed5af62 None None] Calling method '>' {{(pid=104119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:20:41.679650 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: INFO nova.api.openstack.requestlog [None req-b406232d-a8ae-4545-a5e7-5fa22ed5af62 None None] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Jun 07 09:20:41.680060 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: [pid: 104119|app: 0|req: 3/4] 10.222.0.57 () {54 vars in 930 bytes} [Tue Jun 7 09:20:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:20:41.739095 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi [None req-721bf4d9-e67a-4451-98fa-1ce0bdfe5666 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "os-flavor-access:is_public": true, "id": "c1", "name": "cirros256", "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "vcpus": 1}} {{(pid=104120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:20:41.758736 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 07 09:20:41.758736 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: warnings.warn(msg) Jun 07 09:20:41.846992 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: INFO nova.api.openstack.requestlog [None req-721bf4d9-e67a-4451-98fa-1ce0bdfe5666 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.160438 Jun 07 09:20:41.847710 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: [pid: 104120|app: 0|req: 2/5] 10.222.0.57 () {64 vars in 1282 bytes} [Tue Jun 7 09:20:41 2022] POST /compute/v2.1/flavors => generated 407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 07 09:20:41.861994 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG dbcounter [-] [104119] Writing DB stats nova_api:SELECT=3 {{(pid=104119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:20:41.863151 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG dbcounter [-] [104119] Writing DB stats nova_cell1:SELECT=3 {{(pid=104119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:20:41.863894 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG dbcounter [-] [104119] Writing DB stats nova_cell0:SELECT=3 {{(pid=104119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:20:41.864852 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG dbcounter [-] [104119] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:20:42.100063 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi [None req-9e656767-1b0b-4151-a87b-59cfe33d4bf8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:20:42.102519 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 07 09:20:42.102519 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: warnings.warn(msg) Jun 07 09:20:42.366747 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: INFO nova.api.openstack.requestlog [None req-9e656767-1b0b-4151-a87b-59cfe33d4bf8 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.510023 Jun 07 09:20:42.370496 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: [pid: 104119|app: 0|req: 4/6] 10.222.0.57 () {64 vars in 1335 bytes} [Tue Jun 7 09:20:41 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:20:44.649075 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi [None req-721bf4d9-e67a-4451-98fa-1ce0bdfe5666 admin admin] Calling method '>' {{(pid=104120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:20:44.650099 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: INFO nova.api.openstack.requestlog [None req-721bf4d9-e67a-4451-98fa-1ce0bdfe5666 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Jun 07 09:20:44.650526 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: [pid: 104120|app: 0|req: 3/7] 10.222.0.57 () {54 vars in 930 bytes} [Tue Jun 7 09:20:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:20:44.755513 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi [None req-fe78bd93-461c-4077-904c-0ee1d5c6d6c0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "ds512M", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "d1", "ram": 512, "disk": 5, "rxtx_factor": 1.0}} {{(pid=104119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:20:44.779878 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 07 09:20:44.779878 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: warnings.warn(msg) Jun 07 09:20:44.890942 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: INFO nova.api.openstack.requestlog [None req-fe78bd93-461c-4077-904c-0ee1d5c6d6c0 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.234696 Jun 07 09:20:44.891533 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: [pid: 104119|app: 0|req: 5/8] 10.222.0.57 () {64 vars in 1282 bytes} [Tue Jun 7 09:20:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 09:20:44.904067 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi [None req-5782f7ea-c18a-45c4-8061-d6126cfec49d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:20:44.907463 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 07 09:20:44.907463 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: warnings.warn(msg) Jun 07 09:20:45.116646 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: INFO nova.api.openstack.requestlog [None req-5782f7ea-c18a-45c4-8061-d6126cfec49d admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.216788 Jun 07 09:20:45.117172 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: [pid: 104120|app: 0|req: 4/9] 10.222.0.57 () {64 vars in 1335 bytes} [Tue Jun 7 09:20:44 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:20:47.406881 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi [None req-fe78bd93-461c-4077-904c-0ee1d5c6d6c0 admin admin] Calling method '>' {{(pid=104119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:20:47.407887 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: INFO nova.api.openstack.requestlog [None req-fe78bd93-461c-4077-904c-0ee1d5c6d6c0 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Jun 07 09:20:47.408543 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: [pid: 104119|app: 0|req: 6/10] 10.222.0.57 () {54 vars in 930 bytes} [Tue Jun 7 09:20:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:20:47.468622 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi [None req-4d2691b1-6cb9-4ece-8845-e47e762c7074 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "vcpus": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "os-flavor-access:is_public": true, "ram": 1024, "rxtx_factor": 1.0, "name": "ds1G"}} {{(pid=104120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:20:47.580560 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: INFO nova.api.openstack.requestlog [None req-4d2691b1-6cb9-4ece-8845-e47e762c7074 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.166072 Jun 07 09:20:47.581730 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: [pid: 104120|app: 0|req: 5/11] 10.222.0.57 () {64 vars in 1282 bytes} [Tue Jun 7 09:20:47 2022] POST /compute/v2.1/flavors => generated 404 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 09:20:47.593509 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi [None req-e925e5ed-dce5-4b0a-866f-c90c64f217a5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:20:47.749619 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: INFO nova.api.openstack.requestlog [None req-e925e5ed-dce5-4b0a-866f-c90c64f217a5 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.160017 Jun 07 09:20:47.750295 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: [pid: 104119|app: 0|req: 7/12] 10.222.0.57 () {64 vars in 1335 bytes} [Tue Jun 7 09:20:47 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:20:50.078929 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi [None req-4d2691b1-6cb9-4ece-8845-e47e762c7074 admin admin] Calling method '>' {{(pid=104120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:20:50.079955 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: INFO nova.api.openstack.requestlog [None req-4d2691b1-6cb9-4ece-8845-e47e762c7074 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Jun 07 09:20:50.080361 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: [pid: 104120|app: 0|req: 6/13] 10.222.0.57 () {54 vars in 930 bytes} [Tue Jun 7 09:20:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:20:50.140905 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi [None req-5108021e-a573-4fe3-8350-31dd93b7b20b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "id": "d3", "vcpus": 2, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 2048, "rxtx_factor": 1.0, "swap": 0}} {{(pid=104119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:20:50.219458 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: INFO nova.api.openstack.requestlog [None req-5108021e-a573-4fe3-8350-31dd93b7b20b admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.133199 Jun 07 09:20:50.220024 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: [pid: 104119|app: 0|req: 8/14] 10.222.0.57 () {64 vars in 1282 bytes} [Tue Jun 7 09:20:50 2022] POST /compute/v2.1/flavors => generated 404 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 09:20:50.232297 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi [None req-a96fcc0a-9109-4ff2-8df1-b136375b52f9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:20:50.320509 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: INFO nova.api.openstack.requestlog [None req-a96fcc0a-9109-4ff2-8df1-b136375b52f9 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091878 Jun 07 09:20:50.321186 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: [pid: 104120|app: 0|req: 7/15] 10.222.0.57 () {64 vars in 1335 bytes} [Tue Jun 7 09:20:50 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:20:52.613377 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi [None req-5108021e-a573-4fe3-8350-31dd93b7b20b admin admin] Calling method '>' {{(pid=104119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:20:52.614390 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: INFO nova.api.openstack.requestlog [None req-5108021e-a573-4fe3-8350-31dd93b7b20b admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Jun 07 09:20:52.614790 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: [pid: 104119|app: 0|req: 9/16] 10.222.0.57 () {54 vars in 930 bytes} [Tue Jun 7 09:20:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:20:52.675941 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi [None req-20518a4b-db54-4122-980b-52df15c55c31 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "vcpus": 4, "name": "ds4G", "disk": 20, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=104120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:20:52.757067 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: INFO nova.api.openstack.requestlog [None req-20518a4b-db54-4122-980b-52df15c55c31 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.135692 Jun 07 09:20:52.758180 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: [pid: 104120|app: 0|req: 8/17] 10.222.0.57 () {64 vars in 1282 bytes} [Tue Jun 7 09:20:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 09:20:52.770656 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi [None req-22d4f76f-80cf-444c-b92b-983364988850 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:20:52.851085 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: INFO nova.api.openstack.requestlog [None req-22d4f76f-80cf-444c-b92b-983364988850 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.084185 Jun 07 09:20:52.851903 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: [pid: 104119|app: 0|req: 10/18] 10.222.0.57 () {64 vars in 1335 bytes} [Tue Jun 7 09:20:52 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:20:55.132162 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi [None req-20518a4b-db54-4122-980b-52df15c55c31 admin admin] Calling method '>' {{(pid=104120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:20:55.133298 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: INFO nova.api.openstack.requestlog [None req-20518a4b-db54-4122-980b-52df15c55c31 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001532 Jun 07 09:20:55.133874 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: [pid: 104120|app: 0|req: 9/19] 10.222.0.57 () {54 vars in 930 bytes} [Tue Jun 7 09:20:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:20:55.195373 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi [None req-4a4afa98-3073-4fcd-be74-5836b5b73008 admin admin] Calling method '>' {{(pid=104119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:20:55.219615 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: INFO nova.api.openstack.requestlog [None req-4a4afa98-3073-4fcd-be74-5836b5b73008 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.079134 Jun 07 09:20:55.220442 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: [pid: 104119|app: 0|req: 11/20] 10.222.0.57 () {60 vars in 1291 bytes} [Tue Jun 7 09:20:55 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:20:58.033805 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi [None req-20518a4b-db54-4122-980b-52df15c55c31 admin admin] Calling method '>' {{(pid=104120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:20:58.034910 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: INFO nova.api.openstack.requestlog [None req-20518a4b-db54-4122-980b-52df15c55c31 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001554 Jun 07 09:20:58.035371 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: [pid: 104120|app: 0|req: 10/21] 10.222.0.57 () {54 vars in 930 bytes} [Tue Jun 7 09:20:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:20:58.109513 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi [None req-7fa19f42-4cf3-4063-addf-7ede35ab0737 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "name": "m1.tiny", "swap": 0, "vcpus": 1, "disk": 1}} {{(pid=104119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:20:58.203450 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: INFO nova.api.openstack.requestlog [None req-7fa19f42-4cf3-4063-addf-7ede35ab0737 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.161009 Jun 07 09:20:58.203928 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: [pid: 104119|app: 0|req: 12/22] 10.222.0.57 () {64 vars in 1282 bytes} [Tue Jun 7 09:20:58 2022] POST /compute/v2.1/flavors => generated 402 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 09:20:58.219713 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi [None req-5dd805e7-89ec-476e-aa5a-1dfb54532e5f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:20:58.309379 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: INFO nova.api.openstack.requestlog [None req-5dd805e7-89ec-476e-aa5a-1dfb54532e5f admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.094483 Jun 07 09:20:58.309969 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: [pid: 104120|app: 0|req: 11/23] 10.222.0.57 () {64 vars in 1332 bytes} [Tue Jun 7 09:20:58 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:21:00.653962 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi [None req-7fa19f42-4cf3-4063-addf-7ede35ab0737 admin admin] Calling method '>' {{(pid=104119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:21:00.655006 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: INFO nova.api.openstack.requestlog [None req-7fa19f42-4cf3-4063-addf-7ede35ab0737 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Jun 07 09:21:00.655400 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: [pid: 104119|app: 0|req: 13/24] 10.222.0.57 () {54 vars in 930 bytes} [Tue Jun 7 09:21:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:21:00.725113 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi [None req-44f72152-a3f4-4d20-8503-ff5662563c81 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 1, "id": "2", "name": "m1.small", "swap": 0, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "rxtx_factor": 1.0}} {{(pid=104120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:21:00.802676 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: INFO nova.api.openstack.requestlog [None req-44f72152-a3f4-4d20-8503-ff5662563c81 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.141319 Jun 07 09:21:00.803149 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: [pid: 104120|app: 0|req: 12/25] 10.222.0.57 () {64 vars in 1282 bytes} [Tue Jun 7 09:21:00 2022] POST /compute/v2.1/flavors => generated 405 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 09:21:00.816843 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi [None req-f73eef59-5053-43d9-8dbc-ce7c0059fead admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:21:00.908699 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: INFO nova.api.openstack.requestlog [None req-f73eef59-5053-43d9-8dbc-ce7c0059fead admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.096618 Jun 07 09:21:00.909325 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: [pid: 104119|app: 0|req: 14/26] 10.222.0.57 () {64 vars in 1332 bytes} [Tue Jun 7 09:21:00 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:21:03.326354 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi [None req-44f72152-a3f4-4d20-8503-ff5662563c81 admin admin] Calling method '>' {{(pid=104120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:21:03.327429 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: INFO nova.api.openstack.requestlog [None req-44f72152-a3f4-4d20-8503-ff5662563c81 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Jun 07 09:21:03.327842 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: [pid: 104120|app: 0|req: 13/27] 10.222.0.57 () {54 vars in 930 bytes} [Tue Jun 7 09:21:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 09:21:03.386648 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi [None req-fefb245f-2934-4590-a375-cd5835d80666 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "3", "ram": 4096, "os-flavor-access:is_public": true, "vcpus": 2, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 40}} {{(pid=104119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:21:03.494574 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: INFO nova.api.openstack.requestlog [None req-fefb245f-2934-4590-a375-cd5835d80666 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.160233 Jun 07 09:21:03.495553 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: [pid: 104119|app: 0|req: 15/28] 10.222.0.57 () {64 vars in 1282 bytes} [Tue Jun 7 09:21:03 2022] POST /compute/v2.1/flavors => generated 406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 09:21:03.508059 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi [None req-2aab848a-66a5-47e6-bd85-a0dab1510eab admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:21:03.589006 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: INFO nova.api.openstack.requestlog [None req-2aab848a-66a5-47e6-bd85-a0dab1510eab admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.084808 Jun 07 09:21:03.589876 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: [pid: 104120|app: 0|req: 14/29] 10.222.0.57 () {64 vars in 1332 bytes} [Tue Jun 7 09:21:03 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:21:05.864105 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi [None req-fefb245f-2934-4590-a375-cd5835d80666 admin admin] Calling method '>' {{(pid=104119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:21:05.865746 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: INFO nova.api.openstack.requestlog [None req-fefb245f-2934-4590-a375-cd5835d80666 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002082 Jun 07 09:21:05.869259 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: [pid: 104119|app: 0|req: 16/30] 10.222.0.57 () {54 vars in 930 bytes} [Tue Jun 7 09:21:05 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:21:05.936196 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi [None req-2d9521b7-ba32-4f38-acdf-f15b908233a1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 80, "id": "4", "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "vcpus": 4, "name": "m1.large"}} {{(pid=104120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:21:06.036257 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: INFO nova.api.openstack.requestlog [None req-2d9521b7-ba32-4f38-acdf-f15b908233a1 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.163365 Jun 07 09:21:06.037236 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: [pid: 104120|app: 0|req: 15/31] 10.222.0.57 () {64 vars in 1282 bytes} [Tue Jun 7 09:21:05 2022] POST /compute/v2.1/flavors => generated 405 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 09:21:06.049321 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi [None req-f3c5b3f5-e300-413c-87af-d44c8c19dc34 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:21:06.135809 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: INFO nova.api.openstack.requestlog [None req-f3c5b3f5-e300-413c-87af-d44c8c19dc34 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.090146 Jun 07 09:21:06.136851 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: [pid: 104119|app: 0|req: 17/32] 10.222.0.57 () {64 vars in 1332 bytes} [Tue Jun 7 09:21:06 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:21:08.584051 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi [None req-2d9521b7-ba32-4f38-acdf-f15b908233a1 admin admin] Calling method '>' {{(pid=104120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:21:08.585101 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: INFO nova.api.openstack.requestlog [None req-2d9521b7-ba32-4f38-acdf-f15b908233a1 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Jun 07 09:21:08.586063 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: [pid: 104120|app: 0|req: 16/33] 10.222.0.57 () {54 vars in 930 bytes} [Tue Jun 7 09:21:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:21:08.652025 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi [None req-19457aba-3f2e-4cf3-b2cc-f826372a7184 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "m1.xlarge", "id": "5", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 160, "vcpus": 8, "ram": 16384}} {{(pid=104119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:21:08.709827 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: INFO nova.api.openstack.requestlog [None req-19457aba-3f2e-4cf3-b2cc-f826372a7184 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.118025 Jun 07 09:21:08.710679 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: [pid: 104119|app: 0|req: 18/34] 10.222.0.57 () {64 vars in 1282 bytes} [Tue Jun 7 09:21:08 2022] POST /compute/v2.1/flavors => generated 408 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 09:21:08.722784 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi [None req-ef7a0fa0-a5df-49b3-a664-ef542d1eeb8c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:21:08.800543 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: INFO nova.api.openstack.requestlog [None req-ef7a0fa0-a5df-49b3-a664-ef542d1eeb8c admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.081368 Jun 07 09:21:08.801898 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: [pid: 104120|app: 0|req: 17/35] 10.222.0.57 () {64 vars in 1332 bytes} [Tue Jun 7 09:21:08 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:21:32.611109 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi [None req-19457aba-3f2e-4cf3-b2cc-f826372a7184 admin admin] Calling method '>' {{(pid=104119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:21:32.612114 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: INFO nova.api.openstack.requestlog [None req-19457aba-3f2e-4cf3-b2cc-f826372a7184 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Jun 07 09:21:32.612511 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: [pid: 104119|app: 0|req: 19/36] 10.222.0.57 () {54 vars in 930 bytes} [Tue Jun 7 09:21:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:21:32.623304 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG dbcounter [-] [104120] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=104120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:21:32.671182 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi [None req-23514b43-4fa4-4a20-9d41-e4572fa75fb6 admin admin] Calling method '>' {{(pid=104120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:21:32.688989 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: INFO nova.api.openstack.requestlog [None req-23514b43-4fa4-4a20-9d41-e4572fa75fb6 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.070349 Jun 07 09:21:32.689481 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: [pid: 104120|app: 0|req: 18/37] 10.222.0.57 () {60 vars in 1291 bytes} [Tue Jun 7 09:21:32 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:21:33.673988 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi [None req-19457aba-3f2e-4cf3-b2cc-f826372a7184 admin admin] Calling method '>' {{(pid=104119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:21:33.675007 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: INFO nova.api.openstack.requestlog [None req-19457aba-3f2e-4cf3-b2cc-f826372a7184 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Jun 07 09:21:33.675412 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: [pid: 104119|app: 0|req: 20/38] 10.222.0.57 () {56 vars in 1074 bytes} [Tue Jun 7 09:21:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:21:33.891001 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi [None req-b1ac3474-414d-4b04-a2fc-4ba228551cd7 admin admin] Calling method '>' {{(pid=104120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:21:33.897325 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: INFO nova.api.openstack.wsgi [None req-b1ac3474-414d-4b04-a2fc-4ba228551cd7 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 07 09:21:33.901095 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi [None req-b1ac3474-414d-4b04-a2fc-4ba228551cd7 admin admin] Request method failure captured: Jun 07 09:21:33.901095 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 07 09:21:33.901095 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: Accept: application/json Jun 07 09:21:33.901095 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: Accept-Encoding: gzip, deflate Jun 07 09:21:33.901095 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: Connection: keep-alive Jun 07 09:21:33.901095 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: Content-Length: 0 Jun 07 09:21:33.901095 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: Host: 10.222.0.57 Jun 07 09:21:33.901095 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: Openstack-Api-Version: compute 2.90 Jun 07 09:21:33.901095 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: Openstack-System-Scope: None Jun 07 09:21:33.901095 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: User-Agent: python-novaclient Jun 07 09:21:33.901095 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: X-Auth-Token: gAAAAABinxid_thHwfyp2AZtz6k4n-8KandBiJWVospZeurBm9GLdWzA7wpe0jklt-5MUufk3xUoizSa9g5GImz7VYYLQzn2M7LGVSX5p-TGzs_6UREk954eKMYAAcVTy2tcnwa9K_CVkIp7U7Y0MS8IyXaXi28CpUO2lKMmd477fj_vxQQeApM Jun 07 09:21:33.901095 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: X-Domain-Id: None Jun 07 09:21:33.901095 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: X-Domain-Name: None Jun 07 09:21:33.901095 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: X-Identity-Status: Confirmed Jun 07 09:21:33.901095 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: X-Is-Admin-Project: True Jun 07 09:21:33.901095 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: X-Openstack-Nova-Api-Version: 2.90 Jun 07 09:21:33.901095 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: X-Project-Domain-Id: default Jun 07 09:21:33.901095 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: X-Project-Domain-Name: Default Jun 07 09:21:33.901095 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: X-Project-Id: 047614873c7a462ea30132f8c49e5842 Jun 07 09:21:33.901095 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: X-Project-Name: admin Jun 07 09:21:33.901095 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: X-Role: reader,admin,member Jun 07 09:21:33.901095 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: X-Roles: reader,admin,member Jun 07 09:21:33.902796 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/047614873c7a462ea30132f8c49e5842"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/047614873c7a462ea30132f8c49e5842"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_047614873c7a462ea30132f8c49e5842"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/047614873c7a462ea30132f8c49e5842"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 07 09:21:33.902796 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: X-Tenant: admin Jun 07 09:21:33.902796 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: X-Tenant-Id: 047614873c7a462ea30132f8c49e5842 Jun 07 09:21:33.902796 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: X-Tenant-Name: admin Jun 07 09:21:33.902796 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: X-User: admin Jun 07 09:21:33.902796 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: X-User-Domain-Id: default Jun 07 09:21:33.902796 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: X-User-Domain-Name: Default Jun 07 09:21:33.902796 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: X-User-Id: a90171f1014d4a6dbe696da11bc1dd7a Jun 07 09:21:33.902796 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: X-User-Name: admin Jun 07 09:21:33.902796 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: method: > Jun 07 09:21:33.902796 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: exception: Flavor 42 could not be found. Jun 07 09:21:33.902796 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: action_args: {'id': '42'} Jun 07 09:21:33.902796 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: {{(pid=104120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 09:21:33.902796 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:21:33.903974 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 07 09:21:33.903974 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 07 09:21:33.903974 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 07 09:21:33.903974 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 07 09:21:33.903974 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 07 09:21:33.903974 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 07 09:21:33.903974 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 07 09:21:33.903974 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 07 09:21:33.903974 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 07 09:21:33.903974 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 09:21:33.903974 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 07 09:21:33.903974 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 07 09:21:33.903974 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 07 09:21:33.903974 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi Jun 07 09:21:33.903974 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:21:33.903974 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi Jun 07 09:21:33.903974 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:21:33.903974 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:21:33.903974 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:21:33.905318 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 09:21:33.905318 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 09:21:33.905318 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 09:21:33.905318 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 09:21:33.905318 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 07 09:21:33.905318 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 07 09:21:33.905318 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 07 09:21:33.905318 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi Jun 07 09:21:33.905318 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:21:33.905318 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi Jun 07 09:21:33.905318 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:21:33.905318 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:21:33.905318 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:21:33.905318 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 09:21:33.905318 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 09:21:33.905318 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 07 09:21:33.905318 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi Jun 07 09:21:33.905318 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi [None req-b1ac3474-414d-4b04-a2fc-4ba228551cd7 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 09:21:33.906655 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: INFO nova.api.openstack.requestlog [None req-b1ac3474-414d-4b04-a2fc-4ba228551cd7 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.065414 Jun 07 09:21:33.906655 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: [pid: 104120|app: 0|req: 19/39] 10.222.0.57 () {60 vars in 1190 bytes} [Tue Jun 7 09:21:33 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 07 09:21:33.912838 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi [None req-2577afe1-eb4b-4230-bdc1-ce66a6194433 admin admin] Calling method '>' {{(pid=104119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:21:33.915957 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG dbcounter [-] [104119] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=104119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:21:33.936349 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: INFO nova.api.openstack.requestlog [None req-2577afe1-eb4b-4230-bdc1-ce66a6194433 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027053 Jun 07 09:21:33.936911 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: [pid: 104119|app: 0|req: 21/40] 10.222.0.57 () {60 vars in 1210 bytes} [Tue Jun 7 09:21:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:21:33.952473 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi [None req-64373648-43e1-4250-9e4c-af8476211614 admin admin] Calling method '>' {{(pid=104120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:21:33.973602 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: INFO nova.api.openstack.requestlog [None req-64373648-43e1-4250-9e4c-af8476211614 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024758 Jun 07 09:21:33.974136 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: [pid: 104120|app: 0|req: 20/41] 10.222.0.57 () {60 vars in 1210 bytes} [Tue Jun 7 09:21:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:21:33.983659 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi [None req-8c145c9e-d209-4456-8a24-938908fc87cf admin admin] Calling method '>' {{(pid=104119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:21:33.989376 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: INFO nova.api.openstack.wsgi [None req-8c145c9e-d209-4456-8a24-938908fc87cf admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 07 09:21:33.993117 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi [None req-8c145c9e-d209-4456-8a24-938908fc87cf admin admin] Request method failure captured: Jun 07 09:21:33.993117 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 07 09:21:33.993117 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: Accept: application/json Jun 07 09:21:33.993117 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: Accept-Encoding: gzip, deflate Jun 07 09:21:33.993117 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: Connection: keep-alive Jun 07 09:21:33.993117 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: Content-Length: 0 Jun 07 09:21:33.993117 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: Host: 10.222.0.57 Jun 07 09:21:33.993117 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: Openstack-Api-Version: compute 2.90 Jun 07 09:21:33.993117 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: Openstack-System-Scope: None Jun 07 09:21:33.993117 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: User-Agent: python-novaclient Jun 07 09:21:33.993117 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: X-Auth-Token: gAAAAABinxid_thHwfyp2AZtz6k4n-8KandBiJWVospZeurBm9GLdWzA7wpe0jklt-5MUufk3xUoizSa9g5GImz7VYYLQzn2M7LGVSX5p-TGzs_6UREk954eKMYAAcVTy2tcnwa9K_CVkIp7U7Y0MS8IyXaXi28CpUO2lKMmd477fj_vxQQeApM Jun 07 09:21:33.993117 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: X-Domain-Id: None Jun 07 09:21:33.993117 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: X-Domain-Name: None Jun 07 09:21:33.993117 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: X-Identity-Status: Confirmed Jun 07 09:21:33.993117 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: X-Is-Admin-Project: True Jun 07 09:21:33.993117 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: X-Openstack-Nova-Api-Version: 2.90 Jun 07 09:21:33.993117 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: X-Project-Domain-Id: default Jun 07 09:21:33.993117 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: X-Project-Domain-Name: Default Jun 07 09:21:33.993117 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: X-Project-Id: 047614873c7a462ea30132f8c49e5842 Jun 07 09:21:33.993117 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: X-Project-Name: admin Jun 07 09:21:33.993117 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: X-Role: reader,admin,member Jun 07 09:21:33.993117 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: X-Roles: reader,admin,member Jun 07 09:21:33.996335 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/047614873c7a462ea30132f8c49e5842"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/047614873c7a462ea30132f8c49e5842"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_047614873c7a462ea30132f8c49e5842"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/047614873c7a462ea30132f8c49e5842"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 07 09:21:33.996335 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: X-Tenant: admin Jun 07 09:21:33.996335 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: X-Tenant-Id: 047614873c7a462ea30132f8c49e5842 Jun 07 09:21:33.996335 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: X-Tenant-Name: admin Jun 07 09:21:33.996335 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: X-User: admin Jun 07 09:21:33.996335 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: X-User-Domain-Id: default Jun 07 09:21:33.996335 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: X-User-Domain-Name: Default Jun 07 09:21:33.996335 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: X-User-Id: a90171f1014d4a6dbe696da11bc1dd7a Jun 07 09:21:33.996335 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: X-User-Name: admin Jun 07 09:21:33.996335 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: method: > Jun 07 09:21:33.996335 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: exception: Flavor 42 could not be found. Jun 07 09:21:33.996335 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: action_args: {'id': '42'} Jun 07 09:21:33.996335 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: {{(pid=104119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 09:21:33.996335 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:21:33.997191 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 07 09:21:33.997191 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 07 09:21:33.997191 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 07 09:21:33.997191 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 07 09:21:33.997191 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 07 09:21:33.997191 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 07 09:21:33.997191 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 07 09:21:33.997191 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 07 09:21:33.997191 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 07 09:21:33.997191 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 09:21:33.997191 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 07 09:21:33.997191 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 07 09:21:33.997191 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 07 09:21:33.997191 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi Jun 07 09:21:33.997191 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:21:33.997191 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi Jun 07 09:21:33.997191 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:21:33.997191 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:21:33.997191 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:21:33.998400 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 09:21:33.998400 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 09:21:33.998400 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 09:21:33.998400 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 09:21:33.998400 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 07 09:21:33.998400 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 07 09:21:33.998400 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 07 09:21:33.998400 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi Jun 07 09:21:33.998400 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:21:33.998400 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi Jun 07 09:21:33.998400 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:21:33.998400 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:21:33.998400 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:21:33.998400 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 09:21:33.998400 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 09:21:33.998400 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 07 09:21:33.998400 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi Jun 07 09:21:33.998400 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi [None req-8c145c9e-d209-4456-8a24-938908fc87cf admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 09:21:33.999860 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: INFO nova.api.openstack.requestlog [None req-8c145c9e-d209-4456-8a24-938908fc87cf admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014977 Jun 07 09:21:33.999860 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: [pid: 104119|app: 0|req: 22/42] 10.222.0.57 () {60 vars in 1190 bytes} [Tue Jun 7 09:21:33 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 07 09:21:34.855127 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi [None req-64373648-43e1-4250-9e4c-af8476211614 admin admin] Calling method '>' {{(pid=104120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:21:34.856156 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: INFO nova.api.openstack.requestlog [None req-64373648-43e1-4250-9e4c-af8476211614 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Jun 07 09:21:34.856544 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: [pid: 104120|app: 0|req: 21/43] 10.222.0.57 () {56 vars in 1074 bytes} [Tue Jun 7 09:21:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:21:35.047171 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi [None req-8e6b67d2-5ae0-4c95-a4db-470d52f1f1a3 admin admin] Calling method '>' {{(pid=104119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:21:35.052320 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: INFO nova.api.openstack.wsgi [None req-8e6b67d2-5ae0-4c95-a4db-470d52f1f1a3 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 07 09:21:35.053851 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi [None req-8e6b67d2-5ae0-4c95-a4db-470d52f1f1a3 admin admin] Request method failure captured: Jun 07 09:21:35.053851 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 07 09:21:35.053851 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: Accept: application/json Jun 07 09:21:35.053851 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: Accept-Encoding: gzip, deflate Jun 07 09:21:35.053851 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: Connection: keep-alive Jun 07 09:21:35.053851 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: Content-Length: 0 Jun 07 09:21:35.053851 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: Host: 10.222.0.57 Jun 07 09:21:35.053851 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: Openstack-Api-Version: compute 2.90 Jun 07 09:21:35.053851 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: Openstack-System-Scope: None Jun 07 09:21:35.053851 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: User-Agent: python-novaclient Jun 07 09:21:35.053851 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: X-Auth-Token: gAAAAABinxieta5YDzlL4DVZ9Ik0R3Th2l1meS7UbJpxkGCA61pBwjbFYKkTwHppqrqvkBpulPLxBIVz24-EjYsjtNay2FydnmPFmvh5VTmWLr8U2YYS7j3wGLRVUnN22tdLA0wZsB7e3aU2nNa1ZjlckyoJC4C482XaUZqqm-XqVC6GpDBuLw0 Jun 07 09:21:35.053851 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: X-Domain-Id: None Jun 07 09:21:35.053851 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: X-Domain-Name: None Jun 07 09:21:35.053851 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: X-Identity-Status: Confirmed Jun 07 09:21:35.053851 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: X-Is-Admin-Project: True Jun 07 09:21:35.053851 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: X-Openstack-Nova-Api-Version: 2.90 Jun 07 09:21:35.053851 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: X-Project-Domain-Id: default Jun 07 09:21:35.053851 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: X-Project-Domain-Name: Default Jun 07 09:21:35.053851 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: X-Project-Id: 047614873c7a462ea30132f8c49e5842 Jun 07 09:21:35.053851 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: X-Project-Name: admin Jun 07 09:21:35.053851 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: X-Role: reader,admin,member Jun 07 09:21:35.053851 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: X-Roles: reader,admin,member Jun 07 09:21:35.056009 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/047614873c7a462ea30132f8c49e5842"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/047614873c7a462ea30132f8c49e5842"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_047614873c7a462ea30132f8c49e5842"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/047614873c7a462ea30132f8c49e5842"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 07 09:21:35.056009 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: X-Tenant: admin Jun 07 09:21:35.056009 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: X-Tenant-Id: 047614873c7a462ea30132f8c49e5842 Jun 07 09:21:35.056009 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: X-Tenant-Name: admin Jun 07 09:21:35.056009 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: X-User: admin Jun 07 09:21:35.056009 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: X-User-Domain-Id: default Jun 07 09:21:35.056009 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: X-User-Domain-Name: Default Jun 07 09:21:35.056009 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: X-User-Id: a90171f1014d4a6dbe696da11bc1dd7a Jun 07 09:21:35.056009 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: X-User-Name: admin Jun 07 09:21:35.056009 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: method: > Jun 07 09:21:35.056009 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: exception: Flavor 84 could not be found. Jun 07 09:21:35.056009 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: action_args: {'id': '84'} Jun 07 09:21:35.056009 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: {{(pid=104119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 09:21:35.056009 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:21:35.056917 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 07 09:21:35.056917 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 07 09:21:35.056917 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 07 09:21:35.056917 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 07 09:21:35.056917 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 07 09:21:35.056917 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 07 09:21:35.056917 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 07 09:21:35.056917 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 07 09:21:35.056917 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 07 09:21:35.056917 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 09:21:35.056917 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 07 09:21:35.056917 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 07 09:21:35.056917 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 07 09:21:35.056917 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi Jun 07 09:21:35.056917 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:21:35.056917 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi Jun 07 09:21:35.056917 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:21:35.056917 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:21:35.056917 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:21:35.057985 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 09:21:35.057985 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 09:21:35.057985 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 09:21:35.057985 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 09:21:35.057985 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 07 09:21:35.057985 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 07 09:21:35.057985 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 07 09:21:35.057985 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi Jun 07 09:21:35.057985 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:21:35.057985 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi Jun 07 09:21:35.057985 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:21:35.057985 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:21:35.057985 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:21:35.057985 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 09:21:35.057985 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 09:21:35.057985 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 07 09:21:35.057985 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi Jun 07 09:21:35.057985 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi [None req-8e6b67d2-5ae0-4c95-a4db-470d52f1f1a3 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 09:21:35.059121 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: INFO nova.api.openstack.requestlog [None req-8e6b67d2-5ae0-4c95-a4db-470d52f1f1a3 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.062226 Jun 07 09:21:35.059121 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: [pid: 104119|app: 0|req: 23/44] 10.222.0.57 () {60 vars in 1190 bytes} [Tue Jun 7 09:21:34 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 07 09:21:35.065711 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi [None req-6807d8fc-4c58-47b5-93a9-36ae8fe8986c admin admin] Calling method '>' {{(pid=104120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:21:35.079370 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: INFO nova.api.openstack.requestlog [None req-6807d8fc-4c58-47b5-93a9-36ae8fe8986c admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017244 Jun 07 09:21:35.079886 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: [pid: 104120|app: 0|req: 22/45] 10.222.0.57 () {60 vars in 1210 bytes} [Tue Jun 7 09:21:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:21:35.088968 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi [None req-ba00f7e4-585d-40dc-818f-5955d5cf88cb admin admin] Calling method '>' {{(pid=104119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:21:35.103014 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: INFO nova.api.openstack.requestlog [None req-ba00f7e4-585d-40dc-818f-5955d5cf88cb admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017525 Jun 07 09:21:35.103529 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: [pid: 104119|app: 0|req: 24/46] 10.222.0.57 () {60 vars in 1210 bytes} [Tue Jun 7 09:21:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 09:21:35.112197 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi [None req-3ce947ae-cfbc-4651-b03b-3ca08eb0fc17 admin admin] Calling method '>' {{(pid=104120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:21:35.117994 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: INFO nova.api.openstack.wsgi [None req-3ce947ae-cfbc-4651-b03b-3ca08eb0fc17 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 07 09:21:35.119810 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi [None req-3ce947ae-cfbc-4651-b03b-3ca08eb0fc17 admin admin] Request method failure captured: Jun 07 09:21:35.119810 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 07 09:21:35.119810 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: Accept: application/json Jun 07 09:21:35.119810 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: Accept-Encoding: gzip, deflate Jun 07 09:21:35.119810 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: Connection: keep-alive Jun 07 09:21:35.119810 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: Content-Length: 0 Jun 07 09:21:35.119810 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: Host: 10.222.0.57 Jun 07 09:21:35.119810 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: Openstack-Api-Version: compute 2.90 Jun 07 09:21:35.119810 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: Openstack-System-Scope: None Jun 07 09:21:35.119810 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: User-Agent: python-novaclient Jun 07 09:21:35.119810 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: X-Auth-Token: gAAAAABinxieta5YDzlL4DVZ9Ik0R3Th2l1meS7UbJpxkGCA61pBwjbFYKkTwHppqrqvkBpulPLxBIVz24-EjYsjtNay2FydnmPFmvh5VTmWLr8U2YYS7j3wGLRVUnN22tdLA0wZsB7e3aU2nNa1ZjlckyoJC4C482XaUZqqm-XqVC6GpDBuLw0 Jun 07 09:21:35.119810 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: X-Domain-Id: None Jun 07 09:21:35.119810 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: X-Domain-Name: None Jun 07 09:21:35.119810 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: X-Identity-Status: Confirmed Jun 07 09:21:35.119810 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: X-Is-Admin-Project: True Jun 07 09:21:35.119810 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: X-Openstack-Nova-Api-Version: 2.90 Jun 07 09:21:35.119810 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: X-Project-Domain-Id: default Jun 07 09:21:35.119810 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: X-Project-Domain-Name: Default Jun 07 09:21:35.119810 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: X-Project-Id: 047614873c7a462ea30132f8c49e5842 Jun 07 09:21:35.119810 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: X-Project-Name: admin Jun 07 09:21:35.119810 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: X-Role: reader,admin,member Jun 07 09:21:35.119810 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: X-Roles: reader,admin,member Jun 07 09:21:35.121446 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/047614873c7a462ea30132f8c49e5842"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/047614873c7a462ea30132f8c49e5842"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_047614873c7a462ea30132f8c49e5842"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/047614873c7a462ea30132f8c49e5842"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 07 09:21:35.121446 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: X-Tenant: admin Jun 07 09:21:35.121446 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: X-Tenant-Id: 047614873c7a462ea30132f8c49e5842 Jun 07 09:21:35.121446 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: X-Tenant-Name: admin Jun 07 09:21:35.121446 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: X-User: admin Jun 07 09:21:35.121446 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: X-User-Domain-Id: default Jun 07 09:21:35.121446 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: X-User-Domain-Name: Default Jun 07 09:21:35.121446 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: X-User-Id: a90171f1014d4a6dbe696da11bc1dd7a Jun 07 09:21:35.121446 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: X-User-Name: admin Jun 07 09:21:35.121446 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: method: > Jun 07 09:21:35.121446 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: exception: Flavor 84 could not be found. Jun 07 09:21:35.121446 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: action_args: {'id': '84'} Jun 07 09:21:35.121446 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: {{(pid=104120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 09:21:35.121446 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:21:35.122457 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 07 09:21:35.122457 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 07 09:21:35.122457 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 07 09:21:35.122457 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 07 09:21:35.122457 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 07 09:21:35.122457 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 07 09:21:35.122457 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 07 09:21:35.122457 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 07 09:21:35.122457 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 07 09:21:35.122457 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 09:21:35.122457 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 07 09:21:35.122457 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 07 09:21:35.122457 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 07 09:21:35.122457 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi Jun 07 09:21:35.122457 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:21:35.122457 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi Jun 07 09:21:35.122457 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:21:35.122457 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:21:35.122457 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:21:35.123858 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 09:21:35.123858 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 09:21:35.123858 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 09:21:35.123858 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 09:21:35.123858 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 07 09:21:35.123858 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 07 09:21:35.123858 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 07 09:21:35.123858 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi Jun 07 09:21:35.123858 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:21:35.123858 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi Jun 07 09:21:35.123858 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:21:35.123858 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:21:35.123858 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:21:35.123858 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 09:21:35.123858 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 09:21:35.123858 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 07 09:21:35.123858 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi Jun 07 09:21:35.123858 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi [None req-3ce947ae-cfbc-4651-b03b-3ca08eb0fc17 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 09:21:35.125266 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: INFO nova.api.openstack.requestlog [None req-3ce947ae-cfbc-4651-b03b-3ca08eb0fc17 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012345 Jun 07 09:21:35.125266 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: [pid: 104120|app: 0|req: 23/47] 10.222.0.57 () {60 vars in 1190 bytes} [Tue Jun 7 09:21:35 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 07 09:21:35.974384 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi [None req-ba00f7e4-585d-40dc-818f-5955d5cf88cb admin admin] Calling method '>' {{(pid=104119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:21:35.975386 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: INFO nova.api.openstack.requestlog [None req-ba00f7e4-585d-40dc-818f-5955d5cf88cb admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Jun 07 09:21:35.975779 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: [pid: 104119|app: 0|req: 25/48] 10.222.0.57 () {56 vars in 1074 bytes} [Tue Jun 7 09:21:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:21:36.163577 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi [None req-5e66a5ec-7adb-4c5f-a97e-62c692b65e25 admin admin] Calling method '>' {{(pid=104120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:21:36.170339 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: INFO nova.api.openstack.wsgi [None req-5e66a5ec-7adb-4c5f-a97e-62c692b65e25 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 07 09:21:36.172557 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi [None req-5e66a5ec-7adb-4c5f-a97e-62c692b65e25 admin admin] Request method failure captured: Jun 07 09:21:36.172557 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 07 09:21:36.172557 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: Accept: application/json Jun 07 09:21:36.172557 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: Accept-Encoding: gzip, deflate Jun 07 09:21:36.172557 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: Connection: keep-alive Jun 07 09:21:36.172557 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: Content-Length: 0 Jun 07 09:21:36.172557 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: Host: 10.222.0.57 Jun 07 09:21:36.172557 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: Openstack-Api-Version: compute 2.90 Jun 07 09:21:36.172557 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: Openstack-System-Scope: None Jun 07 09:21:36.172557 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: User-Agent: python-novaclient Jun 07 09:21:36.172557 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: X-Auth-Token: gAAAAABinxifieMoNKxBUo3evvtKL-HhhrmmZlgUGqCEQ6CXRpLmm3KoPYQEw2ru6aXD8eAoCXgbMZ_Pm4giK6lgGyNoIJHqtykzFGGH0f6yLBDXBY3l6hyISLdyAgdf6mhC_QnuEWbFj-7_R64GWbz9UihK_HhFdiH1ZYSFuOd5LryssZpX0m8 Jun 07 09:21:36.172557 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: X-Domain-Id: None Jun 07 09:21:36.172557 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: X-Domain-Name: None Jun 07 09:21:36.172557 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: X-Identity-Status: Confirmed Jun 07 09:21:36.172557 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: X-Is-Admin-Project: True Jun 07 09:21:36.172557 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: X-Openstack-Nova-Api-Version: 2.90 Jun 07 09:21:36.172557 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: X-Project-Domain-Id: default Jun 07 09:21:36.172557 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: X-Project-Domain-Name: Default Jun 07 09:21:36.172557 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: X-Project-Id: 047614873c7a462ea30132f8c49e5842 Jun 07 09:21:36.172557 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: X-Project-Name: admin Jun 07 09:21:36.172557 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: X-Role: reader,admin,member Jun 07 09:21:36.172557 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: X-Roles: reader,admin,member Jun 07 09:21:36.173917 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/047614873c7a462ea30132f8c49e5842"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/047614873c7a462ea30132f8c49e5842"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_047614873c7a462ea30132f8c49e5842"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/047614873c7a462ea30132f8c49e5842"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 07 09:21:36.173917 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: X-Tenant: admin Jun 07 09:21:36.173917 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: X-Tenant-Id: 047614873c7a462ea30132f8c49e5842 Jun 07 09:21:36.173917 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: X-Tenant-Name: admin Jun 07 09:21:36.173917 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: X-User: admin Jun 07 09:21:36.173917 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: X-User-Domain-Id: default Jun 07 09:21:36.173917 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: X-User-Domain-Name: Default Jun 07 09:21:36.173917 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: X-User-Id: a90171f1014d4a6dbe696da11bc1dd7a Jun 07 09:21:36.173917 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: X-User-Name: admin Jun 07 09:21:36.173917 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: method: > Jun 07 09:21:36.173917 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: exception: Flavor 451 could not be found. Jun 07 09:21:36.173917 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: action_args: {'id': '451'} Jun 07 09:21:36.173917 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: {{(pid=104120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 09:21:36.173917 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:21:36.174728 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 07 09:21:36.174728 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 07 09:21:36.174728 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 07 09:21:36.174728 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 07 09:21:36.174728 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 07 09:21:36.174728 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 07 09:21:36.174728 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 07 09:21:36.174728 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 07 09:21:36.174728 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 07 09:21:36.174728 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 09:21:36.174728 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 07 09:21:36.174728 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 07 09:21:36.174728 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 07 09:21:36.174728 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi Jun 07 09:21:36.174728 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:21:36.174728 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi Jun 07 09:21:36.174728 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:21:36.174728 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:21:36.174728 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:21:36.175821 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 09:21:36.175821 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 09:21:36.175821 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 09:21:36.175821 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 09:21:36.175821 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 07 09:21:36.175821 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 07 09:21:36.175821 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 07 09:21:36.175821 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi Jun 07 09:21:36.175821 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:21:36.175821 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi Jun 07 09:21:36.175821 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:21:36.175821 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:21:36.175821 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:21:36.175821 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 09:21:36.175821 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 09:21:36.175821 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 07 09:21:36.175821 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: ERROR nova.api.openstack.wsgi Jun 07 09:21:36.175821 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi [None req-5e66a5ec-7adb-4c5f-a97e-62c692b65e25 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 09:21:36.176899 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: INFO nova.api.openstack.requestlog [None req-5e66a5ec-7adb-4c5f-a97e-62c692b65e25 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.062044 Jun 07 09:21:36.176899 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: [pid: 104120|app: 0|req: 24/49] 10.222.0.57 () {60 vars in 1193 bytes} [Tue Jun 7 09:21:36 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 07 09:21:36.184824 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi [None req-c10b1e26-747f-41db-aac4-527a64074eaa admin admin] Calling method '>' {{(pid=104119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:21:36.198243 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: INFO nova.api.openstack.requestlog [None req-c10b1e26-747f-41db-aac4-527a64074eaa admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016993 Jun 07 09:21:36.198759 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: [pid: 104119|app: 0|req: 26/50] 10.222.0.57 () {60 vars in 1210 bytes} [Tue Jun 7 09:21:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 09:21:36.208650 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi [None req-23078acd-e78b-4d35-b2ad-2e301264ca83 admin admin] Calling method '>' {{(pid=104120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:21:36.225378 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: INFO nova.api.openstack.requestlog [None req-23078acd-e78b-4d35-b2ad-2e301264ca83 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020397 Jun 07 09:21:36.226282 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: [pid: 104120|app: 0|req: 25/51] 10.222.0.57 () {60 vars in 1210 bytes} [Tue Jun 7 09:21:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 09:21:36.235780 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi [None req-cabbc0e5-b63f-4945-8b2b-4ccf58153c4e admin admin] Calling method '>' {{(pid=104119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:21:36.241047 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: INFO nova.api.openstack.wsgi [None req-cabbc0e5-b63f-4945-8b2b-4ccf58153c4e admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 07 09:21:36.243024 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi [None req-cabbc0e5-b63f-4945-8b2b-4ccf58153c4e admin admin] Request method failure captured: Jun 07 09:21:36.243024 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 07 09:21:36.243024 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: Accept: application/json Jun 07 09:21:36.243024 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: Accept-Encoding: gzip, deflate Jun 07 09:21:36.243024 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: Connection: keep-alive Jun 07 09:21:36.243024 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: Content-Length: 0 Jun 07 09:21:36.243024 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: Host: 10.222.0.57 Jun 07 09:21:36.243024 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: Openstack-Api-Version: compute 2.90 Jun 07 09:21:36.243024 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: Openstack-System-Scope: None Jun 07 09:21:36.243024 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: User-Agent: python-novaclient Jun 07 09:21:36.243024 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: X-Auth-Token: gAAAAABinxifieMoNKxBUo3evvtKL-HhhrmmZlgUGqCEQ6CXRpLmm3KoPYQEw2ru6aXD8eAoCXgbMZ_Pm4giK6lgGyNoIJHqtykzFGGH0f6yLBDXBY3l6hyISLdyAgdf6mhC_QnuEWbFj-7_R64GWbz9UihK_HhFdiH1ZYSFuOd5LryssZpX0m8 Jun 07 09:21:36.243024 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: X-Domain-Id: None Jun 07 09:21:36.243024 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: X-Domain-Name: None Jun 07 09:21:36.243024 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: X-Identity-Status: Confirmed Jun 07 09:21:36.243024 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: X-Is-Admin-Project: True Jun 07 09:21:36.243024 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: X-Openstack-Nova-Api-Version: 2.90 Jun 07 09:21:36.243024 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: X-Project-Domain-Id: default Jun 07 09:21:36.243024 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: X-Project-Domain-Name: Default Jun 07 09:21:36.243024 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: X-Project-Id: 047614873c7a462ea30132f8c49e5842 Jun 07 09:21:36.243024 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: X-Project-Name: admin Jun 07 09:21:36.243024 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: X-Role: reader,admin,member Jun 07 09:21:36.243024 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: X-Roles: reader,admin,member Jun 07 09:21:36.244901 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/047614873c7a462ea30132f8c49e5842"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/047614873c7a462ea30132f8c49e5842"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_047614873c7a462ea30132f8c49e5842"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/047614873c7a462ea30132f8c49e5842"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 07 09:21:36.244901 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: X-Tenant: admin Jun 07 09:21:36.244901 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: X-Tenant-Id: 047614873c7a462ea30132f8c49e5842 Jun 07 09:21:36.244901 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: X-Tenant-Name: admin Jun 07 09:21:36.244901 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: X-User: admin Jun 07 09:21:36.244901 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: X-User-Domain-Id: default Jun 07 09:21:36.244901 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: X-User-Domain-Name: Default Jun 07 09:21:36.244901 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: X-User-Id: a90171f1014d4a6dbe696da11bc1dd7a Jun 07 09:21:36.244901 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: X-User-Name: admin Jun 07 09:21:36.244901 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: method: > Jun 07 09:21:36.244901 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: exception: Flavor 451 could not be found. Jun 07 09:21:36.244901 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: action_args: {'id': '451'} Jun 07 09:21:36.244901 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: {{(pid=104119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 09:21:36.244901 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:21:36.245740 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 07 09:21:36.245740 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 07 09:21:36.245740 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 07 09:21:36.245740 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 07 09:21:36.245740 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 07 09:21:36.245740 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 07 09:21:36.245740 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 07 09:21:36.245740 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 07 09:21:36.245740 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 07 09:21:36.245740 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 09:21:36.245740 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 07 09:21:36.245740 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 07 09:21:36.245740 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 07 09:21:36.245740 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi Jun 07 09:21:36.245740 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:21:36.245740 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi Jun 07 09:21:36.245740 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:21:36.245740 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:21:36.245740 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:21:36.246830 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 09:21:36.246830 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 09:21:36.246830 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 09:21:36.246830 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 09:21:36.246830 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 07 09:21:36.246830 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 07 09:21:36.246830 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 07 09:21:36.246830 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi Jun 07 09:21:36.246830 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:21:36.246830 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi Jun 07 09:21:36.246830 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:21:36.246830 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:21:36.246830 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:21:36.246830 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 09:21:36.246830 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 09:21:36.246830 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 07 09:21:36.246830 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: ERROR nova.api.openstack.wsgi Jun 07 09:21:36.246830 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi [None req-cabbc0e5-b63f-4945-8b2b-4ccf58153c4e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 09:21:36.247933 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: INFO nova.api.openstack.requestlog [None req-cabbc0e5-b63f-4945-8b2b-4ccf58153c4e admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012338 Jun 07 09:21:36.247933 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: [pid: 104119|app: 0|req: 27/52] 10.222.0.57 () {60 vars in 1193 bytes} [Tue Jun 7 09:21:36 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 07 09:21:37.103441 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi [None req-23078acd-e78b-4d35-b2ad-2e301264ca83 admin admin] Calling method '>' {{(pid=104120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:21:37.105019 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: INFO nova.api.openstack.requestlog [None req-23078acd-e78b-4d35-b2ad-2e301264ca83 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002167 Jun 07 09:21:37.105683 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: [pid: 104120|app: 0|req: 26/53] 10.222.0.57 () {56 vars in 1074 bytes} [Tue Jun 7 09:21:37 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 09:21:37.290235 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi [None req-516064e6-8c82-42d9-a851-895a17a02d35 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:21:37.377990 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: INFO nova.api.openstack.requestlog [None req-516064e6-8c82-42d9-a851-895a17a02d35 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.139198 Jun 07 09:21:37.378578 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: [pid: 104119|app: 0|req: 28/54] 10.222.0.57 () {64 vars in 1235 bytes} [Tue Jun 7 09:21:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 09:21:38.239091 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi [None req-23078acd-e78b-4d35-b2ad-2e301264ca83 admin admin] Calling method '>' {{(pid=104120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:21:38.240647 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: INFO nova.api.openstack.requestlog [None req-23078acd-e78b-4d35-b2ad-2e301264ca83 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002154 Jun 07 09:21:38.241301 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: [pid: 104120|app: 0|req: 27/55] 10.222.0.57 () {56 vars in 1074 bytes} [Tue Jun 7 09:21:38 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:21:38.430433 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi [None req-dfd54e34-6c7c-4046-9e8f-b4a8184b86e7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:21:38.520730 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: INFO nova.api.openstack.requestlog [None req-dfd54e34-6c7c-4046-9e8f-b4a8184b86e7 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.141813 Jun 07 09:21:38.521286 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: [pid: 104119|app: 0|req: 29/56] 10.222.0.57 () {64 vars in 1235 bytes} [Tue Jun 7 09:21:38 2022] POST /compute/v2.1/flavors => generated 405 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 09:21:39.379587 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi [None req-23078acd-e78b-4d35-b2ad-2e301264ca83 admin admin] Calling method '>' {{(pid=104120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:21:39.381146 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: INFO nova.api.openstack.requestlog [None req-23078acd-e78b-4d35-b2ad-2e301264ca83 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002159 Jun 07 09:21:39.381789 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: [pid: 104120|app: 0|req: 28/57] 10.222.0.57 () {56 vars in 1074 bytes} [Tue Jun 7 09:21:39 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:21:39.566542 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi [None req-ca0b33cd-d7af-4c0b-b70d-1d96ca9a8bd7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:21:39.663411 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: INFO nova.api.openstack.requestlog [None req-ca0b33cd-d7af-4c0b-b70d-1d96ca9a8bd7 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.147257 Jun 07 09:21:39.664546 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: [pid: 104119|app: 0|req: 30/58] 10.222.0.57 () {64 vars in 1235 bytes} [Tue Jun 7 09:21:39 2022] POST /compute/v2.1/flavors => generated 407 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 09:21:40.522376 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi [None req-23078acd-e78b-4d35-b2ad-2e301264ca83 admin admin] Calling method '>' {{(pid=104120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:21:40.523993 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: INFO nova.api.openstack.requestlog [None req-23078acd-e78b-4d35-b2ad-2e301264ca83 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002231 Jun 07 09:21:40.524661 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: [pid: 104120|app: 0|req: 29/59] 10.222.0.57 () {56 vars in 1074 bytes} [Tue Jun 7 09:21:40 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:21:40.714367 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi [None req-e53b32bf-2005-42c9-80f4-78f3eeac5955 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:21:40.767216 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: INFO nova.api.openstack.requestlog [None req-e53b32bf-2005-42c9-80f4-78f3eeac5955 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.104176 Jun 07 09:21:40.767706 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: [pid: 104119|app: 0|req: 31/60] 10.222.0.57 () {64 vars in 1235 bytes} [Tue Jun 7 09:21:40 2022] POST /compute/v2.1/flavors => generated 409 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 09:21:41.625139 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi [None req-23078acd-e78b-4d35-b2ad-2e301264ca83 admin admin] Calling method '>' {{(pid=104120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:21:41.626708 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: INFO nova.api.openstack.requestlog [None req-23078acd-e78b-4d35-b2ad-2e301264ca83 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002248 Jun 07 09:21:41.627366 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: [pid: 104120|app: 0|req: 30/61] 10.222.0.57 () {56 vars in 1074 bytes} [Tue Jun 7 09:21:41 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:21:41.813502 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi [None req-0e884e3c-8e31-4406-b804-6958238a86d9 admin admin] Calling method '>' {{(pid=104119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:21:41.832751 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: INFO nova.api.openstack.requestlog [None req-0e884e3c-8e31-4406-b804-6958238a86d9 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.070137 Jun 07 09:21:41.833284 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: [pid: 104119|app: 0|req: 32/62] 10.222.0.57 () {60 vars in 1202 bytes} [Tue Jun 7 09:21:41 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:22:43.486761 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi [None req-23078acd-e78b-4d35-b2ad-2e301264ca83 admin admin] Calling method '>' {{(pid=104120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:22:43.488278 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: INFO nova.api.openstack.requestlog [None req-23078acd-e78b-4d35-b2ad-2e301264ca83 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002163 Jun 07 09:22:43.488959 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: [pid: 104120|app: 0|req: 31/63] 10.222.0.57 () {54 vars in 930 bytes} [Tue Jun 7 09:22:43 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:22:43.496929 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG dbcounter [-] [104119] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=104119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:22:43.549519 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi [None req-0e640fca-fa6a-4838-906e-1ce124fd4839 admin admin] Calling method '>' {{(pid=104119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:22:43.568285 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: INFO nova.api.openstack.requestlog [None req-0e640fca-fa6a-4838-906e-1ce124fd4839 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.072223 Jun 07 09:22:43.568840 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: [pid: 104119|app: 0|req: 33/64] 10.222.0.57 () {60 vars in 1291 bytes} [Tue Jun 7 09:22:43 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:22:43.590100 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG dbcounter [-] [104120] Writing DB stats nova_api:SELECT=14 {{(pid=104120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:22:43.593812 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi [None req-2e455149-c4e7-45c4-92a5-3c62291c5f4c admin admin] Calling method '>' {{(pid=104120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:22:43.601198 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: INFO nova.api.openstack.requestlog [None req-2e455149-c4e7-45c4-92a5-3c62291c5f4c admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012782 Jun 07 09:22:43.602799 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: [pid: 104120|app: 0|req: 32/65] 10.222.0.57 () {60 vars in 1282 bytes} [Tue Jun 7 09:22:43 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:22:43.612941 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi [None req-55d625bd-ee34-41ed-a60a-041c9fee4d02 admin admin] Calling method '>' {{(pid=104119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:22:43.621279 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: INFO nova.api.openstack.requestlog [None req-55d625bd-ee34-41ed-a60a-041c9fee4d02 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012141 Jun 07 09:22:43.621791 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: [pid: 104119|app: 0|req: 34/66] 10.222.0.57 () {60 vars in 1285 bytes} [Tue Jun 7 09:22:43 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:22:43.633161 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi [None req-604c97da-24b8-4d4d-8424-9fbe812b01d0 admin admin] Calling method '>' {{(pid=104120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:22:43.640564 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: INFO nova.api.openstack.requestlog [None req-604c97da-24b8-4d4d-8424-9fbe812b01d0 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011410 Jun 07 09:22:43.641091 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: [pid: 104120|app: 0|req: 33/67] 10.222.0.57 () {60 vars in 1285 bytes} [Tue Jun 7 09:22:43 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:22:43.651724 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi [None req-7c719a57-acea-41e2-97d4-6dd9948103e7 admin admin] Calling method '>' {{(pid=104119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:22:43.659171 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: INFO nova.api.openstack.requestlog [None req-7c719a57-acea-41e2-97d4-6dd9948103e7 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010837 Jun 07 09:22:43.659681 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: [pid: 104119|app: 0|req: 35/68] 10.222.0.57 () {60 vars in 1282 bytes} [Tue Jun 7 09:22:43 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:26:18.631814 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi [None req-604c97da-24b8-4d4d-8424-9fbe812b01d0 admin admin] Calling method '>' {{(pid=104120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:26:18.632888 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: INFO nova.api.openstack.requestlog [None req-604c97da-24b8-4d4d-8424-9fbe812b01d0 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Jun 07 09:26:18.633287 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: [pid: 104120|app: 0|req: 34/69] 10.222.0.57 () {56 vars in 1074 bytes} [Tue Jun 7 09:26:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:26:18.789367 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG dbcounter [-] [104119] Writing DB stats nova_api:SELECT=6 {{(pid=104119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:26:18.903473 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi [None req-9a04f919-fc3a-4a82-b1c4-916a40979185 admin admin] Calling method '>' {{(pid=104119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:26:18.904656 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 07 09:26:18.904656 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: warnings.warn(msg) Jun 07 09:26:18.905924 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG oslo_concurrency.lockutils [None req-9a04f919-fc3a-4a82-b1c4-916a40979185 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:26:18.906362 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG oslo_concurrency.lockutils [None req-9a04f919-fc3a-4a82-b1c4-916a40979185 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:26:18.907142 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG oslo_concurrency.lockutils [None req-9a04f919-fc3a-4a82-b1c4-916a40979185 admin admin] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:26:18.908064 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG oslo_concurrency.lockutils [None req-9a04f919-fc3a-4a82-b1c4-916a40979185 admin admin] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:26:18.941447 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: INFO nova.api.openstack.requestlog [None req-9a04f919-fc3a-4a82-b1c4-916a40979185 admin admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.153474 Jun 07 09:26:18.942002 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: [pid: 104119|app: 0|req: 36/70] 10.222.0.57 () {60 vars in 1193 bytes} [Tue Jun 7 09:26:18 2022] GET /compute/v2.1/os-services => generated 794 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 09:26:19.815215 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi [None req-604c97da-24b8-4d4d-8424-9fbe812b01d0 admin admin] Calling method '>' {{(pid=104120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:26:19.816222 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: INFO nova.api.openstack.requestlog [None req-604c97da-24b8-4d4d-8424-9fbe812b01d0 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002031 Jun 07 09:26:19.816643 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: [pid: 104120|app: 0|req: 35/71] 10.222.0.57 () {56 vars in 1074 bytes} [Tue Jun 7 09:26:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:26:20.006831 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi [None req-530d7da4-b5f6-449d-b8c5-310d6db434e6 admin admin] Calling method '>' {{(pid=104119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:26:20.008655 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 07 09:26:20.008655 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: warnings.warn(msg) Jun 07 09:26:20.009337 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG oslo_concurrency.lockutils [None req-530d7da4-b5f6-449d-b8c5-310d6db434e6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:26:20.009896 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG oslo_concurrency.lockutils [None req-530d7da4-b5f6-449d-b8c5-310d6db434e6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:26:20.010551 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG oslo_concurrency.lockutils [None req-530d7da4-b5f6-449d-b8c5-310d6db434e6 admin admin] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:26:20.010981 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG oslo_concurrency.lockutils [None req-530d7da4-b5f6-449d-b8c5-310d6db434e6 admin admin] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:26:20.030535 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: INFO nova.api.openstack.requestlog [None req-530d7da4-b5f6-449d-b8c5-310d6db434e6 admin admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.076957 Jun 07 09:26:20.031046 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: [pid: 104119|app: 0|req: 37/72] 10.222.0.57 () {60 vars in 1193 bytes} [Tue Jun 7 09:26:19 2022] GET /compute/v2.1/os-services => generated 794 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 09:26:31.335194 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi [None req-604c97da-24b8-4d4d-8424-9fbe812b01d0 admin admin] Calling method '>' {{(pid=104120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:26:31.336210 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: INFO nova.api.openstack.requestlog [None req-604c97da-24b8-4d4d-8424-9fbe812b01d0 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Jun 07 09:26:31.336629 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: [pid: 104120|app: 0|req: 36/73] 10.222.0.57 () {56 vars in 1074 bytes} [Tue Jun 7 09:26:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:26:31.478378 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG dbcounter [-] [104119] Writing DB stats nova_cell0:SELECT=4 {{(pid=104119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:26:31.479097 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG dbcounter [-] [104119] Writing DB stats nova_cell1:SELECT=4 {{(pid=104119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:26:31.479714 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG dbcounter [-] [104119] Writing DB stats nova_api:SELECT=8 {{(pid=104119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:26:31.527382 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi [None req-73f23a2e-f1bf-41ac-bb26-42ba86948997 admin admin] Calling method '>' {{(pid=104119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:26:31.528619 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 07 09:26:31.528619 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: warnings.warn(msg) Jun 07 09:26:31.539641 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG oslo_concurrency.lockutils [None req-73f23a2e-f1bf-41ac-bb26-42ba86948997 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:26:31.539641 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG oslo_concurrency.lockutils [None req-73f23a2e-f1bf-41ac-bb26-42ba86948997 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:26:31.539641 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG oslo_concurrency.lockutils [None req-73f23a2e-f1bf-41ac-bb26-42ba86948997 admin admin] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:26:31.539641 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG oslo_concurrency.lockutils [None req-73f23a2e-f1bf-41ac-bb26-42ba86948997 admin admin] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:26:31.557646 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: INFO nova.api.openstack.requestlog [None req-73f23a2e-f1bf-41ac-bb26-42ba86948997 admin admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.083571 Jun 07 09:26:31.558142 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: [pid: 104119|app: 0|req: 38/74] 10.222.0.57 () {60 vars in 1193 bytes} [Tue Jun 7 09:26:31 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:26:32.419040 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: DEBUG nova.api.openstack.wsgi [None req-604c97da-24b8-4d4d-8424-9fbe812b01d0 admin admin] Calling method '>' {{(pid=104120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:26:32.420053 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: INFO nova.api.openstack.requestlog [None req-604c97da-24b8-4d4d-8424-9fbe812b01d0 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Jun 07 09:26:32.420458 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: [pid: 104120|app: 0|req: 37/75] 10.222.0.57 () {56 vars in 1074 bytes} [Tue Jun 7 09:26:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:26:32.611295 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG nova.api.openstack.wsgi [None req-b7f6ebc9-b501-4bd5-857e-7d60bab67ca0 admin admin] Calling method '>' {{(pid=104119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:26:32.612756 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 07 09:26:32.612756 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: warnings.warn(msg) Jun 07 09:26:32.613992 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG oslo_concurrency.lockutils [None req-b7f6ebc9-b501-4bd5-857e-7d60bab67ca0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:26:32.614424 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG oslo_concurrency.lockutils [None req-b7f6ebc9-b501-4bd5-857e-7d60bab67ca0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:26:32.615194 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG oslo_concurrency.lockutils [None req-b7f6ebc9-b501-4bd5-857e-7d60bab67ca0 admin admin] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:26:32.615659 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: DEBUG oslo_concurrency.lockutils [None req-b7f6ebc9-b501-4bd5-857e-7d60bab67ca0 admin admin] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:26:32.637921 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: INFO nova.api.openstack.requestlog [None req-b7f6ebc9-b501-4bd5-857e-7d60bab67ca0 admin admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.078432 Jun 07 09:26:32.638400 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: [pid: 104119|app: 0|req: 39/76] 10.222.0.57 () {60 vars in 1193 bytes} [Tue Jun 7 09:26:32 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:27:30.901245 dv-cinder-836996-31-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 07 09:27:30.901879 dv-cinder-836996-31-iscsi devstack@n-api.service[104118]: Tue Jun 7 09:27:30 2022 - graceful shutdown triggered... Jun 07 09:27:30.902351 dv-cinder-836996-31-iscsi devstack@n-api.service[104120]: Gracefully killing worker 2 (pid: 104120)... Jun 07 09:27:30.902825 dv-cinder-836996-31-iscsi devstack@n-api.service[104119]: Gracefully killing worker 1 (pid: 104119)... Jun 07 09:27:31.902862 dv-cinder-836996-31-iscsi devstack@n-api.service[104118]: worker 1 buried after 1 seconds Jun 07 09:27:31.902862 dv-cinder-836996-31-iscsi devstack@n-api.service[104118]: worker 2 buried after 1 seconds Jun 07 09:27:31.902862 dv-cinder-836996-31-iscsi devstack@n-api.service[104118]: goodbye to uWSGI. Jun 07 09:27:31.904420 dv-cinder-836996-31-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 07 09:27:31.904999 dv-cinder-836996-31-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 07 09:27:31.908368 dv-cinder-836996-31-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 07 09:27:31.926820 dv-cinder-836996-31-iscsi devstack@n-api.service[118723]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 07 09:27:31.948761 dv-cinder-836996-31-iscsi devstack@n-api.service[118723]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jun 7 09:27:31 2022] *** Jun 07 09:27:31.948761 dv-cinder-836996-31-iscsi devstack@n-api.service[118723]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 07 09:27:31.948761 dv-cinder-836996-31-iscsi devstack@n-api.service[118723]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 07 09:27:31.948761 dv-cinder-836996-31-iscsi devstack@n-api.service[118723]: nodename: dv-cinder-836996-31-iscsi Jun 07 09:27:31.948761 dv-cinder-836996-31-iscsi devstack@n-api.service[118723]: machine: x86_64 Jun 07 09:27:31.948761 dv-cinder-836996-31-iscsi devstack@n-api.service[118723]: clock source: unix Jun 07 09:27:31.948761 dv-cinder-836996-31-iscsi devstack@n-api.service[118723]: pcre jit disabled Jun 07 09:27:31.948761 dv-cinder-836996-31-iscsi devstack@n-api.service[118723]: detected number of CPU cores: 4 Jun 07 09:27:31.948761 dv-cinder-836996-31-iscsi devstack@n-api.service[118723]: current working directory: / Jun 07 09:27:31.948761 dv-cinder-836996-31-iscsi devstack@n-api.service[118723]: detected binary path: /usr/bin/uwsgi-core Jun 07 09:27:31.948761 dv-cinder-836996-31-iscsi devstack@n-api.service[118723]: your processes number limit is 47680 Jun 07 09:27:31.948761 dv-cinder-836996-31-iscsi devstack@n-api.service[118723]: your memory page size is 4096 bytes Jun 07 09:27:31.948761 dv-cinder-836996-31-iscsi devstack@n-api.service[118723]: detected max file descriptor number: 2048 Jun 07 09:27:31.948761 dv-cinder-836996-31-iscsi devstack@n-api.service[118723]: lock engine: pthread robust mutexes Jun 07 09:27:31.949851 dv-cinder-836996-31-iscsi devstack@n-api.service[118723]: thunder lock: enabled Jun 07 09:27:31.949851 dv-cinder-836996-31-iscsi devstack@n-api.service[118723]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 07 09:27:31.949851 dv-cinder-836996-31-iscsi devstack@n-api.service[118723]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 07 09:27:31.994411 dv-cinder-836996-31-iscsi devstack@n-api.service[118723]: Python main interpreter initialized at 0x5617836a29c0 Jun 07 09:27:31.994411 dv-cinder-836996-31-iscsi devstack@n-api.service[118723]: python threads support enabled Jun 07 09:27:31.994411 dv-cinder-836996-31-iscsi devstack@n-api.service[118723]: your server socket listen backlog is limited to 100 connections Jun 07 09:27:31.994411 dv-cinder-836996-31-iscsi devstack@n-api.service[118723]: your mercy for graceful operations on workers is 90 seconds Jun 07 09:27:31.994823 dv-cinder-836996-31-iscsi devstack@n-api.service[118723]: mapped 403077 bytes (393 KB) for 2 cores Jun 07 09:27:31.994823 dv-cinder-836996-31-iscsi devstack@n-api.service[118723]: *** Operational MODE: preforking *** Jun 07 09:27:31.995087 dv-cinder-836996-31-iscsi devstack@n-api.service[118723]: *** uWSGI is running in multiple interpreter mode *** Jun 07 09:27:31.995087 dv-cinder-836996-31-iscsi devstack@n-api.service[118723]: spawned uWSGI master process (pid: 118723) Jun 07 09:27:31.995291 dv-cinder-836996-31-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 07 09:27:31.995886 dv-cinder-836996-31-iscsi devstack@n-api.service[118723]: spawned uWSGI worker 1 (pid: 118740, cores: 1) Jun 07 09:27:31.996258 dv-cinder-836996-31-iscsi devstack@n-api.service[118723]: spawned uWSGI worker 2 (pid: 118741, cores: 1) Jun 07 09:27:31.996453 dv-cinder-836996-31-iscsi devstack@n-api.service[118723]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 07 09:27:33.222525 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 07 09:27:33.229685 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 07 09:27:34.057790 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 07 09:27:34.057790 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: from cryptography.utils import int_from_bytes Jun 07 09:27:34.058133 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 07 09:27:34.058133 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: from cryptography.utils import int_from_bytes Jun 07 09:27:34.064008 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 07 09:27:34.064008 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: from cryptography.utils import int_from_bytes Jun 07 09:27:34.064351 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 07 09:27:34.064351 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: from cryptography.utils import int_from_bytes Jun 07 09:27:36.415405 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 07 09:27:36.416027 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 07 09:27:36.416359 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 07 09:27:36.416556 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 07 09:27:36.416841 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 07 09:27:36.417225 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.417549 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.417888 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.418208 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.418525 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.418836 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.419157 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.419477 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.419809 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.420079 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.420394 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.420744 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836996-31-iscsi {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.421070 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.421381 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.421692 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.422044 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.422352 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.422679 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.422983 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.423485 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.425166 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.425166 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.425166 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.425166 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.425548 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.425548 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.425865 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.426203 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.426509 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.426838 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.427239 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836996-31-iscsi {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.427545 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.427882 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.428192 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.428613 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.428956 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.429442 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.429681 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.429912 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.430170 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.430502 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.430824 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.431144 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.431466 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.431769 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.432072 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.432380 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.432736 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.433046 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.433361 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.433613 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.433926 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.434249 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.434576 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.434906 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.435158 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.435408 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.435734 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.436102 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.436368 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.436703 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.437012 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.437324 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.437656 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.437961 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.438270 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.438577 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.438897 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.439212 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.439538 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.439850 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.440171 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.440570 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.57 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.440847 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.57 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.441157 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.441501 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.441848 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.442016 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 07 09:27:36.442561 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.442679 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 07 09:27:36.442833 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.442959 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 07 09:27:36.443096 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.443259 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 07 09:27:36.443389 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.443551 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 07 09:27:36.443685 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.443685 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.443908 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.444022 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.444142 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.444257 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.444419 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.444546 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.446206 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.446360 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.446501 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.446653 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.446809 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.447095 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.447243 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.447377 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.447571 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.447717 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.447717 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.447973 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.448105 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.448236 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.448382 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.448382 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.448681 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.448952 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.449089 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836996-31-iscsi {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.449229 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.449229 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.449498 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.449667 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.449667 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.449922 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.450062 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.450211 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.450351 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.450351 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.450616 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.450764 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.450896 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.451119 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.451119 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.451385 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.451535 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.451535 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.451889 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.452032 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.452032 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.452296 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.452540 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.452540 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.452838 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.452979 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.452979 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.453778 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.453924 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.454056 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.454187 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.454879 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.455020 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.455119 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.455206 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.455288 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.455372 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.455445 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.455525 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.455612 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.455731 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.456128 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.456402 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.456545 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.456713 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.456874 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.457125 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.457261 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836996-31-iscsi {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.457432 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.457665 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.457856 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.458034 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.458204 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.458351 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.458632 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.458776 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.458937 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.459226 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.459418 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.459556 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.459688 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.459832 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.460121 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.460265 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.460437 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.460705 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.460865 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.461153 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.461302 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.461530 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.461663 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.461933 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.462080 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.462220 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.462493 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.462629 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.462826 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.462968 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.463147 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.463410 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.463545 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.463766 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.463936 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.464100 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.464401 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.464551 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.464742 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.464920 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.465066 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.465343 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.465487 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.465664 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.466188 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.466339 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.466567 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.466713 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.466845 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.466983 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.466983 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.467285 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.467427 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.467574 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.467715 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.467846 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.468096 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.468238 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.468427 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.468625 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.468781 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.469676 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.469854 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.469989 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.470144 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.470316 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.470461 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.470642 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.470852 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.470982 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.471250 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.471435 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.471577 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.471950 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.472095 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.472241 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.472382 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.472522 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.472816 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.472964 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.473131 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.473300 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.473443 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.473766 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.473902 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.474040 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.474264 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.474409 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.474679 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.474813 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.475001 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.475173 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.475308 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.475613 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.475749 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.475932 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.476296 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.476515 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.476846 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.476996 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.476996 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.477256 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.477393 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.477523 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.477702 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.57 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.477845 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.478049 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.478191 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.57 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.478355 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.478551 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.478695 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.478990 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.479123 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.479300 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.479486 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.479636 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.479934 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.480108 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.480241 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.480446 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.480621 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.480843 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.480992 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.481150 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.481388 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.481530 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.481761 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.481907 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.482129 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.482270 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.482409 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.482672 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.482805 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.482980 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.483204 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.483348 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.483595 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.483728 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.483900 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.484049 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.484220 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.484520 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.484728 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.484875 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.485262 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.485472 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.485699 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.485851 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.486997 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.487151 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.487285 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.487417 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.487559 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.487692 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.487822 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.487961 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.488116 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.488390 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.488549 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.488549 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.488874 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.489006 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.489148 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.489294 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.489294 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.492462 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.492637 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.492637 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.492917 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.493070 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.493205 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.493346 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.493480 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.493621 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.493761 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.493905 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.494082 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.494233 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.494365 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.494506 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.494645 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.494787 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.494925 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.495064 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.495195 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.495334 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.495481 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.495615 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.495615 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.495873 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.496019 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.496194 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.496361 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.496361 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.496670 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.497203 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.497346 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.497480 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.497480 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.497737 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.497880 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.497880 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.498149 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.498289 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.498419 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.498550 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.498550 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.498811 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.498950 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.498950 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.499216 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.499375 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.499518 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.499664 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.499805 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.499946 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.499946 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.500299 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.500506 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.500657 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.500792 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.500792 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.501062 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.501204 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.501204 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.501478 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.501609 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.501739 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.501870 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.501870 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.502145 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.502488 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.502488 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.502748 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.502880 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.503018 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.503160 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.503160 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.503408 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.503539 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.503675 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.503828 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.503828 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.504056 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.504187 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.504187 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.504462 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.504624 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.504757 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.504901 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.504901 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.505158 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.505297 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.505297 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.505555 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.506263 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.506263 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.506529 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.506662 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.506800 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.506957 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.507731 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 09:27:36.507884 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.507884 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.508149 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.508282 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.508414 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.508561 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.508561 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.508856 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.508998 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.509137 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.509283 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.509283 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.509572 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.509715 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.509863 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.509995 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.509995 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.510301 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.510444 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.510444 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.510693 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.510824 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.510969 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.511101 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.511101 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.511355 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.511498 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.511629 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.511773 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.511905 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.512200 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.512364 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.512759 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.512891 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.513038 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.513172 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.513312 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.513445 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.513582 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.513750 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.514045 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.514185 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.514433 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.514582 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.514715 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.514954 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.515100 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.515297 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.515441 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.515607 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.516392 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.516674 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.516810 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.516938 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.517068 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.517470 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.517815 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.517966 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.518106 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.518248 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.518397 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.518538 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.518685 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.518822 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.519003 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.519396 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.519914 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.520060 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.520203 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.520345 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.520437 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.520437 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.520815 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.520916 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.520916 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.521068 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.521142 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.521221 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.521528 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.521703 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.521858 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.522013 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.522185 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.522325 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.522500 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.522783 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.522936 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.523097 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.523240 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.523390 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.523532 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.523717 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.523872 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.524016 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.524158 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.524338 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.524508 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.524783 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.524926 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.525091 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.525242 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.525386 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.525533 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.525689 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.525832 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.525976 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.526125 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.526298 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.526441 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.526583 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.526723 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.526864 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.527035 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.527188 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.527370 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.527675 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.527910 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.528064 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.528222 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.528385 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.528539 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.528703 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.528864 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.528965 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.529067 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.529154 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.529239 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.529330 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.529423 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.529518 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.529693 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.529788 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.530004 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.530098 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.530317 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.530421 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.530627 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.530722 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.530943 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.531089 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.531254 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.531437 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.531622 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.531727 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.531927 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.532028 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.532233 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.532350 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.532536 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.532721 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.532884 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.533014 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.533197 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.533308 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.533522 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.533617 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.533829 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.533931 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.534137 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.534235 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.534457 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.534551 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.534766 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.534873 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.535076 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.535177 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.535385 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.535478 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.535690 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.535799 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.535996 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.536089 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.536306 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.536400 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.536638 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.536815 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.536983 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.537134 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.537286 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.537428 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.537603 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.537827 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.537993 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.538144 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.538289 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.538431 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.538582 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.538738 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.538900 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.539062 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.539216 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.539361 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.539513 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.539664 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.539814 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.539962 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.540112 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.540261 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.540424 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.540566 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.540818 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.540989 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.541137 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.541289 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.541447 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.541588 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.541588 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.541864 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.542004 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.542153 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.542350 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.542656 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.542964 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.543224 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.543317 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.543576 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.543679 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.543888 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.543978 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.544204 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.544293 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.544523 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.544653 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.544875 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.544966 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.545195 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.545286 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.545507 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.545591 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.545826 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.545910 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.547222 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.547344 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.547437 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.547532 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.547629 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.547716 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.547826 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.547923 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.548019 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.548112 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.548205 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.548309 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.548409 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.548505 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.548730 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.548833 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.548921 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.549020 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.549170 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.549486 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.549801 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.549981 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.550109 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.550320 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.550422 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.550640 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.550735 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.550968 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.551063 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.551302 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.551410 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.551611 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.551705 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.551917 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.552010 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.552223 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.552327 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.552549 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.552676 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.552903 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.553087 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.553241 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.553502 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.553607 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.553821 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.553923 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.554131 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.554225 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.554456 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.554550 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.554771 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.554872 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.555095 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.555209 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.555408 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.555503 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.555731 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.555823 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.556043 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.556148 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.556358 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.556463 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.556686 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.556784 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.557003 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.557107 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.557312 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.557414 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.557632 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.557726 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.557951 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.558056 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.558265 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.558369 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.558569 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.558671 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.558878 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.558993 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.559186 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.559280 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.559503 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.559598 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.559809 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.559913 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.560117 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.560220 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.560429 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.560523 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.560772 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.560878 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.561079 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.561180 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.561388 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.561487 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.561695 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.561798 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.562001 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.562148 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.562308 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.562401 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.563207 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.563324 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.563421 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.563515 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.563734 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.563844 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.564046 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.564147 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.564363 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.564457 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.564705 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.564818 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.565019 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.565122 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.565324 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.565418 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.565631 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.565735 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.565935 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.566029 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.566252 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.566345 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.566560 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.566669 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.566862 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.566963 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.567167 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.567267 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.567469 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.567563 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.567780 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.567875 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.568088 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.568182 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.568402 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.568508 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.568776 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.568906 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.569090 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.569196 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.569410 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.569505 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.569722 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.569831 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.570034 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.570131 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.570357 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.570452 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.570671 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.570765 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.570974 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.571078 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.571285 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.571378 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.571598 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.571698 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.571994 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.572102 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.572307 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.572402 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.572632 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.572742 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.572943 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.573057 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.573383 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.573494 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.573581 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.573666 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.573853 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.573962 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.574162 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.574256 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.574468 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.574570 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.574795 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.575047 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.575150 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.575387 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.575490 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.575708 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.575817 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.576034 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.576138 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.576357 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.576453 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.576704 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.576816 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.577037 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.577132 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.577370 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.577473 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.577713 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.577810 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.578024 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.578126 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.578887 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.579004 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.579199 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.579304 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.579506 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.579653 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.579817 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.579918 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.580127 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.580256 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.580436 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.580546 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.580768 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.580892 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.581079 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.581183 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.581383 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.581492 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.581690 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.581862 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.582009 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.582149 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.582293 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.582447 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.582588 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.582688 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.582876 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.583022 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.583190 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.583346 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.583598 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.583697 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.583793 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.583970 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.584099 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.584299 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.584403 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.584635 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.584735 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.584947 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.585055 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.585258 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.585365 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.585564 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.585660 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.585871 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.585980 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.586193 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.586295 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.586499 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.586593 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.586812 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.586922 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.587123 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.587218 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.587430 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.587524 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.587735 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.587859 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.588045 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.588183 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.588387 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.588505 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.588701 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.588800 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.589009 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.589110 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.589314 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.589412 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.589627 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.589730 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.589939 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.590034 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.590259 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.590366 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.590545 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.590647 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.590851 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.590954 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.591155 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.591257 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.591454 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.591549 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.591757 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.591858 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.592115 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.592235 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.592360 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.592455 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.592823 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.592936 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.593025 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.593126 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.593290 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.593392 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.593597 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.593720 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.593931 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.594054 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.594235 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.594344 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.594560 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.594654 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.594864 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.594968 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.595169 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.595266 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.595475 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.595570 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.595786 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.595881 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.596094 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.596200 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.596398 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.596500 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.596746 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.596855 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.597056 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.597151 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.597360 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.597452 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.597660 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.597762 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.597964 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.598066 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.598266 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.598360 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.598574 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.598692 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.598875 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.598969 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.599196 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.599313 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.599501 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.599602 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.599807 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.599922 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.600110 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.600215 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.600416 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.600624 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.600747 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.600857 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.601053 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.601165 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.601361 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.601458 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.601666 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.601769 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.601969 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.602129 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.602273 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.602367 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.602577 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.602671 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.602881 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.602984 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.603202 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.603298 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.603510 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.603612 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.603823 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.603947 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.604127 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.604240 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.604438 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.604542 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.604782 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.604876 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.605099 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.605201 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.605408 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.605504 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.605726 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.605822 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.606044 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.606147 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.606359 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.606480 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.606673 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.606897 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.607000 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.607226 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.607334 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.607542 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.607637 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.607858 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.607960 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.608172 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.608267 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.608483 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.608619 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.608818 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.608922 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.609123 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.609217 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.609448 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.609561 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.609768 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.609878 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.610324 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.610422 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.610639 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.610747 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.610960 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.611063 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.611284 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.611387 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.611585 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.611679 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.611897 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.612001 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.612211 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.612318 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.612516 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.612659 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.612855 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.613030 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.613168 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.613272 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.613482 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.613576 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.613800 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.614016 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.614171 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.614325 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.614486 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.614638 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.614810 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.614953 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.615092 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.615236 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.615380 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.615552 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.615711 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.615863 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.616014 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.616159 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.616311 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.616453 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.616632 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.616822 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.616917 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.617005 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.617126 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.617236 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.617432 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.617535 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.617745 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.617850 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.618049 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.618158 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.618433 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.618534 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.618757 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.618883 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.619075 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.619237 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.619381 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.619592 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.619697 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.619910 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.620005 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.620244 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.620364 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.620570 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.620696 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.620899 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.621020 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.621224 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.621325 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.621543 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.621638 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.621870 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.621979 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.622177 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.622285 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.622486 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.622600 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.622786 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.622890 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.623094 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.623195 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.623397 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.623500 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.623704 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.623810 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.624012 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.624188 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.624313 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.624422 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.624655 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.624756 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.624966 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.625554 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.625800 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.626019 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.626374 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.626621 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.626775 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.626930 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.627081 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.627224 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.627375 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.627629 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.627791 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.627942 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.628086 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.628244 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.628397 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.628541 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.628720 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.628886 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.629023 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.629177 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.629341 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.629492 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.629592 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.629758 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.629853 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.630065 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.630168 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.630543 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.630639 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.630715 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.630810 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.631246 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.631347 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.631434 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.631521 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.631607 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.631704 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.631866 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.631969 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.632173 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.632268 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.632477 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.632598 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.632808 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.632913 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.633128 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.633329 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.633479 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.633640 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.633793 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.633936 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.634097 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.634254 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.634405 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.634564 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.634717 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.634868 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.635021 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.635165 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.635385 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.635529 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.635674 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.635817 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.635961 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.636112 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.636279 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.636424 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.636573 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.636707 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.636795 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.636882 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.637046 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.637187 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.637354 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.637497 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.637658 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.637804 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.637974 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.638111 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.638285 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.638436 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.638609 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.638743 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.638942 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.639095 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.639238 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.639367 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.639585 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.639702 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.639900 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.639999 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.640287 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.640437 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.640632 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.641437 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.641558 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.641670 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.641825 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.642007 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.642132 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.642344 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.642442 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.642661 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.642840 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.642995 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.643158 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.643346 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.643496 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.643641 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.643793 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.643943 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.644096 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.644274 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.644456 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.644652 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.644796 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.644962 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.645114 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.645266 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.645410 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.645562 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.645705 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.645856 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.646012 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.646154 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.646305 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.646449 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.646601 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.646754 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.646906 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.647056 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.647200 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.647343 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.647486 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.647640 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.647793 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.647943 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.648086 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.648237 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.648381 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.648538 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.648652 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.648741 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.648828 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.649019 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.649145 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.649338 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.649440 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.649653 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.649757 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.649967 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.650071 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.650280 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.650374 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.650589 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.650681 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.650893 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.650997 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.651225 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.651320 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.651533 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.651647 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.651837 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.651943 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.652170 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.652271 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.652492 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.652633 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.652850 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.652972 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.653162 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.653264 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.653487 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.653591 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.653806 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.653902 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.654121 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.654222 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.654435 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.654532 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.654748 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.654843 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.655059 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.655155 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.655374 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.655481 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.655690 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.655787 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.656002 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.656097 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.656331 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.656438 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.656682 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.656793 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.656990 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.657092 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.657297 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.657517 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.657613 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.657848 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.657944 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.658164 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.658267 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.658477 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.658581 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.658793 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.658893 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.659104 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.659254 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.659410 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.659582 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.659716 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.659899 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.660020 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.660213 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.660347 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.660530 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.660656 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.660872 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.660977 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.661204 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.661301 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.661515 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.661757 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.661856 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.661943 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.662114 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.662210 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.662418 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.662513 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.662729 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.662839 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.663034 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.663140 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.663341 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.663437 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.663647 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.663759 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.663951 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.664047 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.664254 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.664350 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.664618 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.664722 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.664941 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.665036 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.665265 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.665367 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.665620 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.665723 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.665888 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.665997 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.666203 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.666296 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.666511 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.666605 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.666822 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.666924 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.667133 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.667239 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.667447 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.667549 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.667757 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.667861 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.668080 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.668189 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.668391 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.668484 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.668745 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.668845 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.669063 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.669176 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.669374 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.669467 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.669687 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.669782 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.669998 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.670205 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.670311 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.670537 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.670642 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.670861 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.670967 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.671188 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.671291 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.671515 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.671611 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.671833 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.672001 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.672178 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.672273 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.672493 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.672636 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.672829 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.672941 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.673150 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.673257 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.673461 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.673564 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.673780 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.673880 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.674093 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.674196 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.674406 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.674507 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.674716 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.674811 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.675030 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.675123 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.675346 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.675439 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.675656 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.675752 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.675974 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.676192 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.676287 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.676540 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.676678 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.676885 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.676983 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.677214 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.677316 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.677540 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.677637 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.677859 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.677954 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.678165 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.678260 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.678488 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.678594 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.678795 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.678892 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.679046 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 07 09:27:36.679141 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.679407 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.679719 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.680023 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.680328 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.680662 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.680974 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.681278 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.681589 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.681896 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.682224 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.682529 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.682833 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.683138 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.683448 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.683755 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.684059 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.684364 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.684710 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.685032 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.685337 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.685645 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.685950 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.686262 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.686567 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.686875 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.687227 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.687551 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.688398 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.688727 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.689048 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.689360 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.689683 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.689997 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.690343 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.690694 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.691015 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.691560 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.691900 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.692262 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.692555 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.692915 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.693228 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.693536 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.693844 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.694168 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.694480 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.694791 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.695105 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.695419 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.695730 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.696040 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.696350 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.696684 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.696997 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.697307 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.697618 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.697928 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.698238 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.698554 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.698895 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.699216 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.699535 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.699853 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.700173 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.700486 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.700824 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.701139 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.701449 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.701770 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.702103 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.702422 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.702727 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.703146 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.704097 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.704420 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.704772 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.705087 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.705415 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.705740 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.706055 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.706382 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.706696 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.707028 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.707368 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.707699 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.708027 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.708335 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.708674 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.708984 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.709294 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.709615 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.709930 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.710253 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.710540 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.710849 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.711155 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.711463 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.711768 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.712078 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.712479 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.712715 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.713021 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.713325 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.713629 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.713933 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.714239 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.714547 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.714850 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.715155 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.715466 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.715773 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.716074 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.716407 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.716784 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.717104 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.717425 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.717738 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.718059 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.718371 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.718693 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.719041 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.719358 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.719666 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.720003 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.720313 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.720652 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.720969 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.721280 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.721591 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.721901 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.722231 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.722558 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.722866 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.723190 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.723512 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.723831 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.724151 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.724464 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.724822 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.725138 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.725456 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.725774 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.726084 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.726398 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.726716 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.727032 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.727360 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.727687 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.727998 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.728321 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.728675 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.729027 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.729344 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.729689 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.730025 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.730344 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.730659 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.730967 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 09:27:36.731210 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 07 09:27:36.741605 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO dbcounter [None req-8cf396ec-8e79-42c7-abdf-c48402c8ca51 None None] Registered counter for database nova_api Jun 07 09:27:36.760508 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_db.sqlalchemy.engines [None req-8cf396ec-8e79-42c7-abdf-c48402c8ca51 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118741) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 09:27:36.767701 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writer thread running {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 09:27:36.794247 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO dbcounter [None req-251d9004-f02a-466e-9afa-be4a452af7f0 None None] Registered counter for database nova_api Jun 07 09:27:36.814353 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_db.sqlalchemy.engines [None req-251d9004-f02a-466e-9afa-be4a452af7f0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118740) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 09:27:36.820919 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writer thread running {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 09:27:36.823662 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.context [None req-8cf396ec-8e79-42c7-abdf-c48402c8ca51 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),10588278-77f2-4e92-84e1-e5f9671c3564(cell1) {{(pid=118741) load_cells /opt/stack/nova/nova/context.py:464}} Jun 07 09:27:36.827780 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-8cf396ec-8e79-42c7-abdf-c48402c8ca51 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:27:36.830002 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-8cf396ec-8e79-42c7-abdf-c48402c8ca51 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:27:36.830812 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-8cf396ec-8e79-42c7-abdf-c48402c8ca51 None None] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:27:36.832827 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-8cf396ec-8e79-42c7-abdf-c48402c8ca51 None None] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:27:36.834810 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO dbcounter [None req-8cf396ec-8e79-42c7-abdf-c48402c8ca51 None None] Registered counter for database nova_cell0 Jun 07 09:27:36.840197 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO dbcounter [None req-8cf396ec-8e79-42c7-abdf-c48402c8ca51 None None] Registered counter for database nova_cell1 Jun 07 09:27:36.847604 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_db.sqlalchemy.engines [None req-8cf396ec-8e79-42c7-abdf-c48402c8ca51 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118741) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 09:27:36.849819 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_db.sqlalchemy.engines [None req-8cf396ec-8e79-42c7-abdf-c48402c8ca51 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118741) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 09:27:36.856195 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writer thread running {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 09:27:36.856532 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writer thread running {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 09:27:36.877140 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.context [None req-251d9004-f02a-466e-9afa-be4a452af7f0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),10588278-77f2-4e92-84e1-e5f9671c3564(cell1) {{(pid=118740) load_cells /opt/stack/nova/nova/context.py:464}} Jun 07 09:27:36.881324 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-251d9004-f02a-466e-9afa-be4a452af7f0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:27:36.882981 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-251d9004-f02a-466e-9afa-be4a452af7f0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:27:36.883777 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-251d9004-f02a-466e-9afa-be4a452af7f0 None None] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:27:36.885771 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-251d9004-f02a-466e-9afa-be4a452af7f0 None None] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:27:36.887744 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO dbcounter [None req-251d9004-f02a-466e-9afa-be4a452af7f0 None None] Registered counter for database nova_cell0 Jun 07 09:27:36.893616 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO dbcounter [None req-251d9004-f02a-466e-9afa-be4a452af7f0 None None] Registered counter for database nova_cell1 Jun 07 09:27:36.901404 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_db.sqlalchemy.engines [None req-251d9004-f02a-466e-9afa-be4a452af7f0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118740) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 09:27:36.902376 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_db.sqlalchemy.engines [None req-251d9004-f02a-466e-9afa-be4a452af7f0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118740) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 09:27:36.910200 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writer thread running {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 09:27:36.910546 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writer thread running {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 09:27:37.006184 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO dbcounter [None req-8cf396ec-8e79-42c7-abdf-c48402c8ca51 None None] Registered counter for database nova_cell0 Jun 07 09:27:37.014448 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_db.sqlalchemy.engines [None req-8cf396ec-8e79-42c7-abdf-c48402c8ca51 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118741) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 09:27:37.020519 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writer thread running {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 09:27:37.060304 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO dbcounter [None req-251d9004-f02a-466e-9afa-be4a452af7f0 None None] Registered counter for database nova_cell0 Jun 07 09:27:37.067632 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_db.sqlalchemy.engines [None req-251d9004-f02a-466e-9afa-be4a452af7f0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118740) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 09:27:37.076349 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writer thread running {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 09:27:37.455423 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: WARNING keystonemiddleware.auth_token [None req-8cf396ec-8e79-42c7-abdf-c48402c8ca51 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 07 09:27:37.462809 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: WARNING keystonemiddleware.auth_token [None req-8cf396ec-8e79-42c7-abdf-c48402c8ca51 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 07 09:27:37.519425 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: WARNING keystonemiddleware.auth_token [None req-251d9004-f02a-466e-9afa-be4a452af7f0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 07 09:27:37.526661 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: WARNING keystonemiddleware.auth_token [None req-251d9004-f02a-466e-9afa-be4a452af7f0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 07 09:27:37.687108 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: WARNING keystonemiddleware.auth_token [None req-8cf396ec-8e79-42c7-abdf-c48402c8ca51 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 07 09:27:37.693747 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: WARNING keystonemiddleware.auth_token [None req-8cf396ec-8e79-42c7-abdf-c48402c8ca51 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 07 09:27:37.698878 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5617836a29c0 pid: 118741 (default app) Jun 07 09:27:37.764671 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: WARNING keystonemiddleware.auth_token [None req-251d9004-f02a-466e-9afa-be4a452af7f0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 07 09:27:37.770851 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: WARNING keystonemiddleware.auth_token [None req-251d9004-f02a-466e-9afa-be4a452af7f0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 07 09:27:37.775971 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5617836a29c0 pid: 118740 (default app) Jun 07 09:28:19.362428 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writing DB stats nova_api:SELECT=3 {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:28:19.364050 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writing DB stats nova_cell0:SELECT=3 {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:28:19.365322 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writing DB stats nova_cell1:SELECT=3 {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:28:19.367828 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writing DB stats nova_cell0:SELECT=3 {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:28:20.291384 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writing DB stats nova_api:SELECT=3 {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:28:20.292722 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writing DB stats nova_cell1:SELECT=3 {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:28:20.297738 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writing DB stats nova_cell0:SELECT=3 {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:28:20.297738 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writing DB stats nova_cell0:SELECT=3 {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:28:20.878645 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-0acdfc62-9ce8-4d1a-824f-e7bee866fbc1 tempest-VolumesSnapshotsTestJSON-777521591 tempest-VolumesSnapshotsTestJSON-777521591-project] Action: 'create', calling method: .version_select at 0x7f5c9464c5e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1657576212"}} {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:28:21.118648 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-588975c7-788d-43f4-80ae-551c1b12c0fa tempest-VolumesGetTestJSON-1350905772 tempest-VolumesGetTestJSON-1350905772-project] Action: 'create', calling method: .version_select at 0x7f5c9464c5e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1548632779", "metadata": {"Type": "work"}}} {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:28:22.475341 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-0acdfc62-9ce8-4d1a-824f-e7bee866fbc1 tempest-VolumesSnapshotsTestJSON-777521591 tempest-VolumesSnapshotsTestJSON-777521591-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.122934 Jun 07 09:28:22.475341 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 1/1] 10.222.0.57 () {60 vars in 1154 bytes} [Tue Jun 7 09:28:19 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3126 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 07 09:28:22.539250 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-cf1f0172-0ab9-4c5f-ab51-1ebaf4bd6f55 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-796217985", "imageRef": "8fdb0275-8c58-4c9e-a2f3-3aae3a947526", "flavorRef": "452", "networks": [{"uuid": "aec61801-ad43-4a1b-af6b-48d5eb6faf20"}]}} {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:28:22.662285 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-588975c7-788d-43f4-80ae-551c1b12c0fa tempest-VolumesGetTestJSON-1350905772 tempest-VolumesGetTestJSON-1350905772-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 2.388176 Jun 07 09:28:22.669730 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 1/2] 10.222.0.57 () {60 vars in 1155 bytes} [Tue Jun 7 09:28:20 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 2391 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 07 09:28:22.669730 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-fdb6a5bf-d74e-4b58-b705-b544a0d1b5dc tempest-VolumesSnapshotsTestJSON-777521591 tempest-VolumesSnapshotsTestJSON-777521591-project] Calling method '.version_select at 0x7f5c945155e0>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:28:22.699364 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.network.neutron [None req-cf1f0172-0ab9-4c5f-ab51-1ebaf4bd6f55 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] validate_networks() for [('aec61801-ad43-4a1b-af6b-48d5eb6faf20', None, None, None, None, None)] {{(pid=118741) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 09:28:22.748430 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-fdb6a5bf-d74e-4b58-b705-b544a0d1b5dc tempest-VolumesSnapshotsTestJSON-777521591 tempest-VolumesSnapshotsTestJSON-777521591-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/2fc52df7-d952-4f14-a8cd-53764b51a098" status: 200 len: 345 microversion: 2.1 time: 0.083791 Jun 07 09:28:22.754425 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 2/3] 10.222.0.57 () {58 vars in 1244 bytes} [Tue Jun 7 09:28:22 2022] GET /compute/v2.1/os-volumes/2fc52df7-d952-4f14-a8cd-53764b51a098 => generated 345 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:28:22.754425 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-0b41ba08-ac2e-4aa9-b1fe-94525f967caa tempest-VolumesGetTestJSON-1350905772 tempest-VolumesGetTestJSON-1350905772-project] Calling method '.version_select at 0x7f5c94515700>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:28:22.840936 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-0b41ba08-ac2e-4aa9-b1fe-94525f967caa tempest-VolumesGetTestJSON-1350905772 tempest-VolumesGetTestJSON-1350905772-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/e05a65b0-9d68-45cb-967f-1dfdeef5baea" status: 200 len: 353 microversion: 2.1 time: 0.090066 Jun 07 09:28:22.841511 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 3/4] 10.222.0.57 () {58 vars in 1244 bytes} [Tue Jun 7 09:28:22 2022] GET /compute/v2.1/os-volumes/e05a65b0-9d68-45cb-967f-1dfdeef5baea => generated 353 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:28:23.747323 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.virt.hardware [None req-cf1f0172-0ab9-4c5f-ab51-1ebaf4bd6f55 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Flavor limits 0:0:0 {{(pid=118741) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 09:28:23.748120 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.virt.hardware [None req-cf1f0172-0ab9-4c5f-ab51-1ebaf4bd6f55 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Image limits 0:0:0 {{(pid=118741) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 09:28:23.749824 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.virt.hardware [None req-cf1f0172-0ab9-4c5f-ab51-1ebaf4bd6f55 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Flavor pref 0:0:0 {{(pid=118741) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 09:28:23.750574 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.virt.hardware [None req-cf1f0172-0ab9-4c5f-ab51-1ebaf4bd6f55 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Image pref 0:0:0 {{(pid=118741) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 09:28:23.751244 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.virt.hardware [None req-cf1f0172-0ab9-4c5f-ab51-1ebaf4bd6f55 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118741) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 09:28:23.762458 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-c1ce79cc-81a7-4b6c-b808-f52a9aebd22e tempest-VolumesSnapshotsTestJSON-777521591 tempest-VolumesSnapshotsTestJSON-777521591-project] Calling method '.version_select at 0x7f5c94515e50>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:28:23.769719 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-cf1f0172-0ab9-4c5f-ab51-1ebaf4bd6f55 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:23.770418 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-cf1f0172-0ab9-4c5f-ab51-1ebaf4bd6f55 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:23.772241 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-cf1f0172-0ab9-4c5f-ab51-1ebaf4bd6f55 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:23.780882 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-cf1f0172-0ab9-4c5f-ab51-1ebaf4bd6f55 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:23.851808 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.quota [None req-cf1f0172-0ab9-4c5f-ab51-1ebaf4bd6f55 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Getting quotas for project 986f0a9e430e4caaaed4affc2d4b8aeb. Resources: {'instances', 'cores', 'ram'} {{(pid=118741) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 09:28:23.863514 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-c1ce79cc-81a7-4b6c-b808-f52a9aebd22e tempest-VolumesSnapshotsTestJSON-777521591 tempest-VolumesSnapshotsTestJSON-777521591-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/2fc52df7-d952-4f14-a8cd-53764b51a098" status: 200 len: 345 microversion: 2.1 time: 0.105636 Jun 07 09:28:23.864722 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 4/5] 10.222.0.57 () {58 vars in 1244 bytes} [Tue Jun 7 09:28:23 2022] GET /compute/v2.1/os-volumes/2fc52df7-d952-4f14-a8cd-53764b51a098 => generated 345 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:28:23.869474 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-500585f0-4ec3-4ff4-b4a4-d4eb120fab31 tempest-VolumesGetTestJSON-1350905772 tempest-VolumesGetTestJSON-1350905772-project] Calling method '.version_select at 0x7f5c94523550>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:28:23.876596 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.quota [None req-cf1f0172-0ab9-4c5f-ab51-1ebaf4bd6f55 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Getting quotas for user 9726e11bda974054a1e972c097b1ea1d and project 986f0a9e430e4caaaed4affc2d4b8aeb. Resources: {'instances', 'cores', 'ram'} {{(pid=118741) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 09:28:23.904053 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-cf1f0172-0ab9-4c5f-ab51-1ebaf4bd6f55 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Going to run 1 instances... {{(pid=118741) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 09:28:23.912487 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-cf1f0172-0ab9-4c5f-ab51-1ebaf4bd6f55 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] [instance: 90803094-e09d-4c65-9aba-88d612d0dafd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8fdb0275-8c58-4c9e-a2f3-3aae3a947526',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118741) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 09:28:23.932376 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-500585f0-4ec3-4ff4-b4a4-d4eb120fab31 tempest-VolumesGetTestJSON-1350905772 tempest-VolumesGetTestJSON-1350905772-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/e05a65b0-9d68-45cb-967f-1dfdeef5baea" status: 200 len: 353 microversion: 2.1 time: 0.066484 Jun 07 09:28:23.933373 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 5/6] 10.222.0.57 () {58 vars in 1244 bytes} [Tue Jun 7 09:28:23 2022] GET /compute/v2.1/os-volumes/e05a65b0-9d68-45cb-967f-1dfdeef5baea => generated 353 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:28:24.177715 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-cf1f0172-0ab9-4c5f-ab51-1ebaf4bd6f55 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.698880 Jun 07 09:28:24.190857 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 2/7] 10.222.0.57 () {60 vars in 1146 bytes} [Tue Jun 7 09:28:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1715 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 09:28:24.194883 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-ae14c78f-cc81-4d4c-869f-72ba4b68e5dc tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:28:24.195736 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-ae14c78f-cc81-4d4c-869f-72ba4b68e5dc tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] [instance: 90803094-e09d-4c65-9aba-88d612d0dafd] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:28:24.371231 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-ae14c78f-cc81-4d4c-869f-72ba4b68e5dc tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9726e11bda974054a1e972c097b1ea1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986f0a9e430e4caaaed4affc2d4b8aeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:28:24.397379 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-ae14c78f-cc81-4d4c-869f-72ba4b68e5dc tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] 10.222.0.57 "GET /compute/v2.1/servers/90803094-e09d-4c65-9aba-88d612d0dafd" status: 200 len: 1214 microversion: 2.1 time: 0.206747 Jun 07 09:28:24.400796 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 6/8] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:28:24 2022] GET /compute/v2.1/servers/90803094-e09d-4c65-9aba-88d612d0dafd => generated 1214 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:28:24.558817 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-fd33bfd2-9349-45a4-917a-77acef913514 tempest-VolumesTestJSON-1111874569 tempest-VolumesTestJSON-1111874569-project] Calling method '.version_select at 0x7f5c9442e700>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:28:24.651547 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-fd33bfd2-9349-45a4-917a-77acef913514 tempest-VolumesTestJSON-1111874569 tempest-VolumesTestJSON-1111874569-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/e5704c5f-1758-4247-b7d1-abde0d530ec0" status: 200 len: 351 microversion: 2.1 time: 0.097042 Jun 07 09:28:24.659204 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 3/9] 10.222.0.57 () {58 vars in 1244 bytes} [Tue Jun 7 09:28:24 2022] GET /compute/v2.1/os-volumes/e5704c5f-1758-4247-b7d1-abde0d530ec0 => generated 351 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:28:24.880450 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-ffb767f3-2b68-4391-b318-cdcbbbbb65e7 tempest-VolumesSnapshotsTestJSON-777521591 tempest-VolumesSnapshotsTestJSON-777521591-project] Calling method '.version_select at 0x7f5c944e71f0>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:28:24.955008 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-0eeb9155-2793-4d3f-9e50-e9ebeb709cc1 tempest-VolumesGetTestJSON-1350905772 tempest-VolumesGetTestJSON-1350905772-project] Calling method '.version_select at 0x7f5c9442ee50>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:28:24.981784 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-ffb767f3-2b68-4391-b318-cdcbbbbb65e7 tempest-VolumesSnapshotsTestJSON-777521591 tempest-VolumesSnapshotsTestJSON-777521591-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/2fc52df7-d952-4f14-a8cd-53764b51a098" status: 200 len: 346 microversion: 2.1 time: 0.101515 Jun 07 09:28:24.981784 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 7/10] 10.222.0.57 () {58 vars in 1244 bytes} [Tue Jun 7 09:28:24 2022] GET /compute/v2.1/os-volumes/2fc52df7-d952-4f14-a8cd-53764b51a098 => generated 346 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:28:24.990193 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-bc53f8d6-f46e-4c62-9e52-3fcf79a1834c tempest-VolumesSnapshotsTestJSON-777521591 tempest-VolumesSnapshotsTestJSON-777521591-project] Action: 'create', calling method: .version_select at 0x7f5c944f44c0>, body: {"snapshot": {"volume_id": "2fc52df7-d952-4f14-a8cd-53764b51a098", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-540346425"}} {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:28:25.113596 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-0eeb9155-2793-4d3f-9e50-e9ebeb709cc1 tempest-VolumesGetTestJSON-1350905772 tempest-VolumesGetTestJSON-1350905772-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/e05a65b0-9d68-45cb-967f-1dfdeef5baea" status: 200 len: 354 microversion: 2.1 time: 0.172938 Jun 07 09:28:25.116341 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 4/11] 10.222.0.57 () {58 vars in 1244 bytes} [Tue Jun 7 09:28:24 2022] GET /compute/v2.1/os-volumes/e05a65b0-9d68-45cb-967f-1dfdeef5baea => generated 354 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:28:25.129391 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-072e9022-3b03-49b1-9534-f32dcf5aeba6 tempest-VolumesGetTestJSON-1350905772 tempest-VolumesGetTestJSON-1350905772-project] Calling method '.version_select at 0x7f5c9442eb80>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:28:25.598340 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-072e9022-3b03-49b1-9534-f32dcf5aeba6 tempest-VolumesGetTestJSON-1350905772 tempest-VolumesGetTestJSON-1350905772-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/e05a65b0-9d68-45cb-967f-1dfdeef5baea" status: 200 len: 354 microversion: 2.1 time: 0.473521 Jun 07 09:28:25.604124 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 5/12] 10.222.0.57 () {58 vars in 1244 bytes} [Tue Jun 7 09:28:25 2022] GET /compute/v2.1/os-volumes/e05a65b0-9d68-45cb-967f-1dfdeef5baea => generated 354 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 09:28:25.620260 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-5d03a14c-f147-4529-b2e2-01c64c185552 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:28:25.624131 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-5d03a14c-f147-4529-b2e2-01c64c185552 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] [instance: 90803094-e09d-4c65-9aba-88d612d0dafd] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:28:25.854004 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-5d03a14c-f147-4529-b2e2-01c64c185552 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9726e11bda974054a1e972c097b1ea1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986f0a9e430e4caaaed4affc2d4b8aeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:28:25.869950 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-5d03a14c-f147-4529-b2e2-01c64c185552 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] 10.222.0.57 "GET /compute/v2.1/servers/90803094-e09d-4c65-9aba-88d612d0dafd" status: 200 len: 1214 microversion: 2.1 time: 0.264343 Jun 07 09:28:25.870747 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 6/13] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:28:25 2022] GET /compute/v2.1/servers/90803094-e09d-4c65-9aba-88d612d0dafd => generated 1214 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:28:25.875603 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-0402d455-f8a3-4f90-a3ab-84ac7ddf9f8c tempest-VolumesGetTestJSON-1350905772 tempest-VolumesGetTestJSON-1350905772-project] Calling method '.version_select at 0x7f5c933c6d30>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:28:25.943184 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-bc53f8d6-f46e-4c62-9e52-3fcf79a1834c tempest-VolumesSnapshotsTestJSON-777521591 tempest-VolumesSnapshotsTestJSON-777521591-project] 10.222.0.57 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.960413 Jun 07 09:28:25.944785 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 8/14] 10.222.0.57 () {60 vars in 1161 bytes} [Tue Jun 7 09:28:24 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:28:25.958102 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-a2c421bf-80c6-4e72-b945-f08ea9ef0697 tempest-VolumesSnapshotsTestJSON-777521591 tempest-VolumesSnapshotsTestJSON-777521591-project] Calling method '.version_select at 0x7f5c94484160>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:28:26.028786 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-a2c421bf-80c6-4e72-b945-f08ea9ef0697 tempest-VolumesSnapshotsTestJSON-777521591 tempest-VolumesSnapshotsTestJSON-777521591-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/a3b6e3ca-8553-4143-8b72-9490bb7ef933" status: 200 len: 286 microversion: 2.1 time: 0.074622 Jun 07 09:28:26.034635 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 9/15] 10.222.0.57 () {58 vars in 1250 bytes} [Tue Jun 7 09:28:25 2022] GET /compute/v2.1/os-snapshots/a3b6e3ca-8553-4143-8b72-9490bb7ef933 => generated 286 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 09:28:26.039886 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-e4948269-1692-444f-ad72-9d563f13a903 tempest-VolumesSnapshotsTestJSON-777521591 tempest-VolumesSnapshotsTestJSON-777521591-project] Calling method '.version_select at 0x7f5c944f4d30>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:28:26.094731 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-e4948269-1692-444f-ad72-9d563f13a903 tempest-VolumesSnapshotsTestJSON-777521591 tempest-VolumesSnapshotsTestJSON-777521591-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.058614 Jun 07 09:28:26.100540 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 10/16] 10.222.0.57 () {58 vars in 1139 bytes} [Tue Jun 7 09:28:26 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:28:26.119342 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-59af0ca6-84e8-4587-ab6b-c6de25fef618 tempest-VolumesSnapshotsTestJSON-777521591 tempest-VolumesSnapshotsTestJSON-777521591-project] Calling method '.version_select at 0x7f5c94523dc0>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:28:26.153717 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-0402d455-f8a3-4f90-a3ab-84ac7ddf9f8c tempest-VolumesGetTestJSON-1350905772 tempest-VolumesGetTestJSON-1350905772-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/e05a65b0-9d68-45cb-967f-1dfdeef5baea" status: 202 len: 0 microversion: 2.1 time: 0.281774 Jun 07 09:28:26.154809 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 7/17] 10.222.0.57 () {58 vars in 1247 bytes} [Tue Jun 7 09:28:25 2022] DELETE /compute/v2.1/os-volumes/e05a65b0-9d68-45cb-967f-1dfdeef5baea => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 09:28:26.164032 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-0bec518b-bf97-4458-86c7-ead9536a6fc2 tempest-VolumesGetTestJSON-1350905772 tempest-VolumesGetTestJSON-1350905772-project] Calling method '.version_select at 0x7f5c9442eee0>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:28:26.189614 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-59af0ca6-84e8-4587-ab6b-c6de25fef618 tempest-VolumesSnapshotsTestJSON-777521591 tempest-VolumesSnapshotsTestJSON-777521591-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/a3b6e3ca-8553-4143-8b72-9490bb7ef933" status: 200 len: 286 microversion: 2.1 time: 0.087579 Jun 07 09:28:26.190301 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 11/18] 10.222.0.57 () {58 vars in 1250 bytes} [Tue Jun 7 09:28:26 2022] GET /compute/v2.1/os-snapshots/a3b6e3ca-8553-4143-8b72-9490bb7ef933 => generated 286 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:28:26.236351 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-0bec518b-bf97-4458-86c7-ead9536a6fc2 tempest-VolumesGetTestJSON-1350905772 tempest-VolumesGetTestJSON-1350905772-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/e05a65b0-9d68-45cb-967f-1dfdeef5baea" status: 200 len: 353 microversion: 2.1 time: 0.077109 Jun 07 09:28:26.237115 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 8/19] 10.222.0.57 () {58 vars in 1244 bytes} [Tue Jun 7 09:28:26 2022] GET /compute/v2.1/os-volumes/e05a65b0-9d68-45cb-967f-1dfdeef5baea => generated 353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:28:26.888195 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-e0cdb23a-c4f4-4f8f-9094-b687aec53f68 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:28:26.888847 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-e0cdb23a-c4f4-4f8f-9094-b687aec53f68 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] [instance: 90803094-e09d-4c65-9aba-88d612d0dafd] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:28:26.912668 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-e0cdb23a-c4f4-4f8f-9094-b687aec53f68 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:26.913361 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-e0cdb23a-c4f4-4f8f-9094-b687aec53f68 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:26.913937 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-e0cdb23a-c4f4-4f8f-9094-b687aec53f68 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:26.914405 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-e0cdb23a-c4f4-4f8f-9094-b687aec53f68 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:27.204979 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-74fc3b16-b3eb-4fa2-a1bc-217cb4f9564e tempest-VolumesSnapshotsTestJSON-777521591 tempest-VolumesSnapshotsTestJSON-777521591-project] Calling method '.version_select at 0x7f5c933de8b0>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:28:27.267150 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-e0cdb23a-c4f4-4f8f-9094-b687aec53f68 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9726e11bda974054a1e972c097b1ea1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986f0a9e430e4caaaed4affc2d4b8aeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:28:27.291175 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-e0cdb23a-c4f4-4f8f-9094-b687aec53f68 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] 10.222.0.57 "GET /compute/v2.1/servers/90803094-e09d-4c65-9aba-88d612d0dafd" status: 200 len: 1218 microversion: 2.1 time: 0.407474 Jun 07 09:28:27.301769 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 12/20] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:28:26 2022] GET /compute/v2.1/servers/90803094-e09d-4c65-9aba-88d612d0dafd => generated 1218 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:28:27.322584 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-9b92544f-fa6a-4c5f-9a54-861fa4d29448 tempest-VolumesGetTestJSON-1350905772 tempest-VolumesGetTestJSON-1350905772-project] Calling method '.version_select at 0x7f5c94474d30>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:28:27.375702 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-74fc3b16-b3eb-4fa2-a1bc-217cb4f9564e tempest-VolumesSnapshotsTestJSON-777521591 tempest-VolumesSnapshotsTestJSON-777521591-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/a3b6e3ca-8553-4143-8b72-9490bb7ef933" status: 200 len: 286 microversion: 2.1 time: 0.177887 Jun 07 09:28:27.380185 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 9/21] 10.222.0.57 () {58 vars in 1250 bytes} [Tue Jun 7 09:28:27 2022] GET /compute/v2.1/os-snapshots/a3b6e3ca-8553-4143-8b72-9490bb7ef933 => generated 286 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:28:27.447530 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-9b92544f-fa6a-4c5f-9a54-861fa4d29448 tempest-VolumesGetTestJSON-1350905772 tempest-VolumesGetTestJSON-1350905772-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/e05a65b0-9d68-45cb-967f-1dfdeef5baea" status: 200 len: 353 microversion: 2.1 time: 0.144385 Jun 07 09:28:27.448099 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 13/22] 10.222.0.57 () {58 vars in 1244 bytes} [Tue Jun 7 09:28:27 2022] GET /compute/v2.1/os-volumes/e05a65b0-9d68-45cb-967f-1dfdeef5baea => generated 353 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:28:27.901849 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-a3e6695b-5b4b-4d7c-8f61-302559811085 tempest-VolumesTestJSON-1111874569 tempest-VolumesTestJSON-1111874569-project] Calling method '.version_select at 0x7f5c933e6040>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:28:27.977845 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-a3e6695b-5b4b-4d7c-8f61-302559811085 tempest-VolumesTestJSON-1111874569 tempest-VolumesTestJSON-1111874569-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/2aabf64a-b9b4-4638-8258-75d3480220f9" status: 200 len: 351 microversion: 2.1 time: 0.081245 Jun 07 09:28:27.978427 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 10/23] 10.222.0.57 () {58 vars in 1244 bytes} [Tue Jun 7 09:28:27 2022] GET /compute/v2.1/os-volumes/2aabf64a-b9b4-4638-8258-75d3480220f9 => generated 351 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:28:28.309309 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-e25dcf89-a2b4-404d-b6b1-cad680bd8213 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:28:28.310086 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-e25dcf89-a2b4-404d-b6b1-cad680bd8213 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] [instance: 90803094-e09d-4c65-9aba-88d612d0dafd] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:28:28.336971 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-e25dcf89-a2b4-404d-b6b1-cad680bd8213 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:28.337692 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-e25dcf89-a2b4-404d-b6b1-cad680bd8213 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:28.348134 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-e25dcf89-a2b4-404d-b6b1-cad680bd8213 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:28.349012 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-e25dcf89-a2b4-404d-b6b1-cad680bd8213 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:28.388086 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-918de2aa-721b-4097-9f1d-b7801cc8bdce tempest-VolumesSnapshotsTestJSON-777521591 tempest-VolumesSnapshotsTestJSON-777521591-project] Calling method '.version_select at 0x7f5c933deb80>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:28:28.444048 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-918de2aa-721b-4097-9f1d-b7801cc8bdce tempest-VolumesSnapshotsTestJSON-777521591 tempest-VolumesSnapshotsTestJSON-777521591-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/a3b6e3ca-8553-4143-8b72-9490bb7ef933" status: 200 len: 286 microversion: 2.1 time: 0.060019 Jun 07 09:28:28.445070 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 11/24] 10.222.0.57 () {58 vars in 1250 bytes} [Tue Jun 7 09:28:28 2022] GET /compute/v2.1/os-snapshots/a3b6e3ca-8553-4143-8b72-9490bb7ef933 => generated 286 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:28:28.459715 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-5b55c22b-98d7-4785-8992-c04228b37ae3 tempest-VolumesGetTestJSON-1350905772 tempest-VolumesGetTestJSON-1350905772-project] Calling method '.version_select at 0x7f5c933de4c0>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:28:28.547091 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-5b55c22b-98d7-4785-8992-c04228b37ae3 tempest-VolumesGetTestJSON-1350905772 tempest-VolumesGetTestJSON-1350905772-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/e05a65b0-9d68-45cb-967f-1dfdeef5baea" status: 200 len: 353 microversion: 2.1 time: 0.091646 Jun 07 09:28:28.548113 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 12/25] 10.222.0.57 () {58 vars in 1244 bytes} [Tue Jun 7 09:28:28 2022] GET /compute/v2.1/os-volumes/e05a65b0-9d68-45cb-967f-1dfdeef5baea => generated 353 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:28:28.726026 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-e25dcf89-a2b4-404d-b6b1-cad680bd8213 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9726e11bda974054a1e972c097b1ea1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986f0a9e430e4caaaed4affc2d4b8aeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:28:28.740872 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-e25dcf89-a2b4-404d-b6b1-cad680bd8213 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] 10.222.0.57 "GET /compute/v2.1/servers/90803094-e09d-4c65-9aba-88d612d0dafd" status: 200 len: 1210 microversion: 2.1 time: 0.435334 Jun 07 09:28:28.751306 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 14/26] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:28:28 2022] GET /compute/v2.1/servers/90803094-e09d-4c65-9aba-88d612d0dafd => generated 1210 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:28:29.456029 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-0e88dcd5-5811-4786-9cd7-8e80c763f071 tempest-VolumesSnapshotsTestJSON-777521591 tempest-VolumesSnapshotsTestJSON-777521591-project] Calling method '.version_select at 0x7f5c933e63a0>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:28:29.503234 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-0e88dcd5-5811-4786-9cd7-8e80c763f071 tempest-VolumesSnapshotsTestJSON-777521591 tempest-VolumesSnapshotsTestJSON-777521591-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/a3b6e3ca-8553-4143-8b72-9490bb7ef933" status: 200 len: 286 microversion: 2.1 time: 0.051570 Jun 07 09:28:29.507425 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 13/27] 10.222.0.57 () {58 vars in 1250 bytes} [Tue Jun 7 09:28:29 2022] GET /compute/v2.1/os-snapshots/a3b6e3ca-8553-4143-8b72-9490bb7ef933 => generated 286 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:28:29.560352 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-d198ff7a-38de-409e-b2fa-17c12cf49a5c tempest-VolumesGetTestJSON-1350905772 tempest-VolumesGetTestJSON-1350905772-project] Calling method '.version_select at 0x7f5c9447b790>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:28:29.659481 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-d198ff7a-38de-409e-b2fa-17c12cf49a5c tempest-VolumesGetTestJSON-1350905772 tempest-VolumesGetTestJSON-1350905772-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/e05a65b0-9d68-45cb-967f-1dfdeef5baea" status: 200 len: 353 microversion: 2.1 time: 0.104014 Jun 07 09:28:29.660054 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 15/28] 10.222.0.57 () {58 vars in 1244 bytes} [Tue Jun 7 09:28:29 2022] GET /compute/v2.1/os-volumes/e05a65b0-9d68-45cb-967f-1dfdeef5baea => generated 353 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:28:29.763136 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-f6476135-5dbd-4885-b360-2f80ec78b581 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:28:29.763760 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-f6476135-5dbd-4885-b360-2f80ec78b581 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] [instance: 90803094-e09d-4c65-9aba-88d612d0dafd] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:28:29.775479 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-f6476135-5dbd-4885-b360-2f80ec78b581 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:29.777917 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-f6476135-5dbd-4885-b360-2f80ec78b581 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:29.780517 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-f6476135-5dbd-4885-b360-2f80ec78b581 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:29.781141 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-f6476135-5dbd-4885-b360-2f80ec78b581 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:30.298559 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-f6476135-5dbd-4885-b360-2f80ec78b581 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9726e11bda974054a1e972c097b1ea1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986f0a9e430e4caaaed4affc2d4b8aeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:28:30.321529 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-f6476135-5dbd-4885-b360-2f80ec78b581 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] 10.222.0.57 "GET /compute/v2.1/servers/90803094-e09d-4c65-9aba-88d612d0dafd" status: 200 len: 1210 microversion: 2.1 time: 0.562655 Jun 07 09:28:30.322657 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 14/29] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:28:29 2022] GET /compute/v2.1/servers/90803094-e09d-4c65-9aba-88d612d0dafd => generated 1210 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:28:30.515261 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-28758fe2-34d1-4020-80d4-1d1f2fe5eb9f tempest-VolumesSnapshotsTestJSON-777521591 tempest-VolumesSnapshotsTestJSON-777521591-project] Calling method '.version_select at 0x7f5c9447b9d0>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:28:30.575565 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-28758fe2-34d1-4020-80d4-1d1f2fe5eb9f tempest-VolumesSnapshotsTestJSON-777521591 tempest-VolumesSnapshotsTestJSON-777521591-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/a3b6e3ca-8553-4143-8b72-9490bb7ef933" status: 200 len: 286 microversion: 2.1 time: 0.063995 Jun 07 09:28:30.577743 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 16/30] 10.222.0.57 () {58 vars in 1250 bytes} [Tue Jun 7 09:28:30 2022] GET /compute/v2.1/os-snapshots/a3b6e3ca-8553-4143-8b72-9490bb7ef933 => generated 286 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:28:30.672290 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-66cbd33e-3fca-4501-b2ed-b4b5ba08bcec tempest-VolumesGetTestJSON-1350905772 tempest-VolumesGetTestJSON-1350905772-project] Calling method '.version_select at 0x7f5c933de9d0>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:28:30.759507 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-66cbd33e-3fca-4501-b2ed-b4b5ba08bcec tempest-VolumesGetTestJSON-1350905772 tempest-VolumesGetTestJSON-1350905772-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/e05a65b0-9d68-45cb-967f-1dfdeef5baea" status: 200 len: 353 microversion: 2.1 time: 0.092074 Jun 07 09:28:30.760073 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 15/31] 10.222.0.57 () {58 vars in 1244 bytes} [Tue Jun 7 09:28:30 2022] GET /compute/v2.1/os-volumes/e05a65b0-9d68-45cb-967f-1dfdeef5baea => generated 353 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:28:30.946110 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-19c46e64-949f-402f-81ad-c145799a9775 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Action: 'create', calling method: .version_select at 0x7f5c9447be50>, body: {"keypair": {"name": "tempest-keypair-1834568858", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHAsSwy6bZjtytEOuaAuXPXfZVClICyDrGtxDPTHUkOihaNuutNAU9FMakbwSJ/Jtt+4LJqMfqf7gUAVnktnaOSrQCqDs3Ccq72crwKjaFzSyMUTgnUkBHc2cgrXKMhbNA=="}} {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:28:31.061412 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.quota [None req-19c46e64-949f-402f-81ad-c145799a9775 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Getting quotas for project 1c21b1cbbd604d6d9c97ab7c3c788f3d. Resources: {'key_pairs'} {{(pid=118740) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 09:28:31.080915 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.quota [None req-19c46e64-949f-402f-81ad-c145799a9775 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Getting quotas for user 0346f4e3855142059983083e71c2c0c3 and project 1c21b1cbbd604d6d9c97ab7c3c788f3d. Resources: {'key_pairs'} {{(pid=118740) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 09:28:31.307489 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-19c46e64-949f-402f-81ad-c145799a9775 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.460120 Jun 07 09:28:31.315114 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 17/32] 10.222.0.57 () {60 vars in 1158 bytes} [Tue Jun 7 09:28:30 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:28:31.340294 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-4fcf2567-be26-4265-911c-cae46b73d043 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:28:31.341170 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-4fcf2567-be26-4265-911c-cae46b73d043 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] [instance: 90803094-e09d-4c65-9aba-88d612d0dafd] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:28:31.351488 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-4fcf2567-be26-4265-911c-cae46b73d043 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:31.357247 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-4fcf2567-be26-4265-911c-cae46b73d043 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:31.358455 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-4fcf2567-be26-4265-911c-cae46b73d043 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:31.360848 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-4fcf2567-be26-4265-911c-cae46b73d043 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:31.520451 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-4fcf2567-be26-4265-911c-cae46b73d043 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9726e11bda974054a1e972c097b1ea1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986f0a9e430e4caaaed4affc2d4b8aeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:28:31.534330 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-4fcf2567-be26-4265-911c-cae46b73d043 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] 10.222.0.57 "GET /compute/v2.1/servers/90803094-e09d-4c65-9aba-88d612d0dafd" status: 200 len: 1210 microversion: 2.1 time: 0.198721 Jun 07 09:28:31.542839 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 16/33] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:28:31 2022] GET /compute/v2.1/servers/90803094-e09d-4c65-9aba-88d612d0dafd => generated 1210 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:28:31.607610 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-61076c86-8141-4df3-b6dc-1b2c74faf903 tempest-VolumesSnapshotsTestJSON-777521591 tempest-VolumesSnapshotsTestJSON-777521591-project] Calling method '.version_select at 0x7f5c9438ab80>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:28:31.652261 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-61076c86-8141-4df3-b6dc-1b2c74faf903 tempest-VolumesSnapshotsTestJSON-777521591 tempest-VolumesSnapshotsTestJSON-777521591-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/a3b6e3ca-8553-4143-8b72-9490bb7ef933" status: 200 len: 286 microversion: 2.1 time: 0.053348 Jun 07 09:28:31.653296 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 18/34] 10.222.0.57 () {58 vars in 1250 bytes} [Tue Jun 7 09:28:31 2022] GET /compute/v2.1/os-snapshots/a3b6e3ca-8553-4143-8b72-9490bb7ef933 => generated 286 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:28:31.772661 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-f8e42902-4837-4386-98b6-60c41095dd0f tempest-VolumesGetTestJSON-1350905772 tempest-VolumesGetTestJSON-1350905772-project] Calling method '.version_select at 0x7f5c933658b0>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:28:31.866253 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-f8e42902-4837-4386-98b6-60c41095dd0f tempest-VolumesGetTestJSON-1350905772 tempest-VolumesGetTestJSON-1350905772-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/e05a65b0-9d68-45cb-967f-1dfdeef5baea" status: 200 len: 353 microversion: 2.1 time: 0.098619 Jun 07 09:28:31.867014 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 17/35] 10.222.0.57 () {58 vars in 1244 bytes} [Tue Jun 7 09:28:31 2022] GET /compute/v2.1/os-volumes/e05a65b0-9d68-45cb-967f-1dfdeef5baea => generated 353 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:28:32.552857 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-803d54c6-23f7-49cc-8ed6-a517361c27b2 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:28:32.553778 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-803d54c6-23f7-49cc-8ed6-a517361c27b2 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] [instance: 90803094-e09d-4c65-9aba-88d612d0dafd] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:28:32.565467 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-803d54c6-23f7-49cc-8ed6-a517361c27b2 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:32.569395 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-803d54c6-23f7-49cc-8ed6-a517361c27b2 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:32.571910 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-803d54c6-23f7-49cc-8ed6-a517361c27b2 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:32.573833 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-803d54c6-23f7-49cc-8ed6-a517361c27b2 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:32.665492 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-38cfc870-3cea-41b4-bcca-56e8a4ab99cf tempest-VolumesSnapshotsTestJSON-777521591 tempest-VolumesSnapshotsTestJSON-777521591-project] Calling method '.version_select at 0x7f5c93365b80>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:28:32.722762 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-38cfc870-3cea-41b4-bcca-56e8a4ab99cf tempest-VolumesSnapshotsTestJSON-777521591 tempest-VolumesSnapshotsTestJSON-777521591-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/a3b6e3ca-8553-4143-8b72-9490bb7ef933" status: 200 len: 286 microversion: 2.1 time: 0.061604 Jun 07 09:28:32.724767 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 18/36] 10.222.0.57 () {58 vars in 1250 bytes} [Tue Jun 7 09:28:32 2022] GET /compute/v2.1/os-snapshots/a3b6e3ca-8553-4143-8b72-9490bb7ef933 => generated 286 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:28:32.846108 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-803d54c6-23f7-49cc-8ed6-a517361c27b2 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9726e11bda974054a1e972c097b1ea1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986f0a9e430e4caaaed4affc2d4b8aeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:28:32.856073 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-803d54c6-23f7-49cc-8ed6-a517361c27b2 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] 10.222.0.57 "GET /compute/v2.1/servers/90803094-e09d-4c65-9aba-88d612d0dafd" status: 200 len: 1210 microversion: 2.1 time: 0.305560 Jun 07 09:28:32.872767 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 19/37] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:28:32 2022] GET /compute/v2.1/servers/90803094-e09d-4c65-9aba-88d612d0dafd => generated 1210 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:28:32.880096 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-86364fdd-ec7f-4c88-bad3-0cefb8b86091 tempest-VolumesGetTestJSON-1350905772 tempest-VolumesGetTestJSON-1350905772-project] Calling method '.version_select at 0x7f5c93370ee0>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:28:33.055707 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-86364fdd-ec7f-4c88-bad3-0cefb8b86091 tempest-VolumesGetTestJSON-1350905772 tempest-VolumesGetTestJSON-1350905772-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/e05a65b0-9d68-45cb-967f-1dfdeef5baea" status: 200 len: 353 microversion: 2.1 time: 0.179843 Jun 07 09:28:33.060574 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 19/38] 10.222.0.57 () {58 vars in 1244 bytes} [Tue Jun 7 09:28:32 2022] GET /compute/v2.1/os-volumes/e05a65b0-9d68-45cb-967f-1dfdeef5baea => generated 353 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:28:33.737807 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-63e1df2b-6ea9-4c5d-8d37-2c105600f652 tempest-VolumesSnapshotsTestJSON-777521591 tempest-VolumesSnapshotsTestJSON-777521591-project] Calling method '.version_select at 0x7f5c943b9430>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:28:33.812919 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-63e1df2b-6ea9-4c5d-8d37-2c105600f652 tempest-VolumesSnapshotsTestJSON-777521591 tempest-VolumesSnapshotsTestJSON-777521591-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/a3b6e3ca-8553-4143-8b72-9490bb7ef933" status: 200 len: 287 microversion: 2.1 time: 0.081290 Jun 07 09:28:33.813613 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 20/39] 10.222.0.57 () {58 vars in 1250 bytes} [Tue Jun 7 09:28:33 2022] GET /compute/v2.1/os-snapshots/a3b6e3ca-8553-4143-8b72-9490bb7ef933 => generated 287 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:28:33.827519 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-9c46a82d-c7ba-42d9-8326-2818e617bd62 tempest-VolumesSnapshotsTestJSON-777521591 tempest-VolumesSnapshotsTestJSON-777521591-project] Calling method '.version_select at 0x7f5c9449fb80>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:28:33.835332 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writing DB stats nova_cell0:SELECT=2 {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:28:33.873783 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-97b27f7a-254e-4113-bde7-5d562e8d346b tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:28:33.875098 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-97b27f7a-254e-4113-bde7-5d562e8d346b tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] [instance: 90803094-e09d-4c65-9aba-88d612d0dafd] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:28:33.888402 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-97b27f7a-254e-4113-bde7-5d562e8d346b tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:33.889622 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-97b27f7a-254e-4113-bde7-5d562e8d346b tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:33.890552 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-97b27f7a-254e-4113-bde7-5d562e8d346b tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:33.891418 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-97b27f7a-254e-4113-bde7-5d562e8d346b tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:34.156176 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-9c46a82d-c7ba-42d9-8326-2818e617bd62 tempest-VolumesSnapshotsTestJSON-777521591 tempest-VolumesSnapshotsTestJSON-777521591-project] 10.222.0.57 "DELETE /compute/v2.1/os-snapshots/a3b6e3ca-8553-4143-8b72-9490bb7ef933" status: 202 len: 0 microversion: 2.1 time: 0.334743 Jun 07 09:28:34.160365 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 20/40] 10.222.0.57 () {58 vars in 1253 bytes} [Tue Jun 7 09:28:33 2022] DELETE /compute/v2.1/os-snapshots/a3b6e3ca-8553-4143-8b72-9490bb7ef933 => generated 0 bytes in 337 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 09:28:34.163217 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-8ce4f462-f719-4bc7-a377-f6ba3099acd6 tempest-VolumesGetTestJSON-1350905772 tempest-VolumesGetTestJSON-1350905772-project] Calling method '.version_select at 0x7f5c93365280>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:28:34.218788 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-97b27f7a-254e-4113-bde7-5d562e8d346b tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9726e11bda974054a1e972c097b1ea1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986f0a9e430e4caaaed4affc2d4b8aeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:28:34.223928 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.wsgi [None req-8ce4f462-f719-4bc7-a377-f6ba3099acd6 tempest-VolumesGetTestJSON-1350905772 tempest-VolumesGetTestJSON-1350905772-project] HTTP exception thrown: Volume e05a65b0-9d68-45cb-967f-1dfdeef5baea could not be found. Jun 07 09:28:34.232391 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-8ce4f462-f719-4bc7-a377-f6ba3099acd6 tempest-VolumesGetTestJSON-1350905772 tempest-VolumesGetTestJSON-1350905772-project] Request method failure captured: Jun 07 09:28:34.232391 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: request: GET /compute/v2.1/os-volumes/e05a65b0-9d68-45cb-967f-1dfdeef5baea HTTP/1.1 Jun 07 09:28:34.232391 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Accept: application/json Jun 07 09:28:34.232391 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Accept-Encoding: identity Jun 07 09:28:34.232391 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Connection: close Jun 07 09:28:34.232391 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Content-Length: 0 Jun 07 09:28:34.232391 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Content-Type: application/json Jun 07 09:28:34.232391 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Host: 10.222.0.57 Jun 07 09:28:34.232391 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Openstack-System-Scope: None Jun 07 09:28:34.232391 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: User-Agent: python-urllib3/1.26.9 Jun 07 09:28:34.232391 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Auth-Token: gAAAAABinxo0U1ge98MSbErsNT21F9gsoKkyVtByevjFaYrjLil3W2_JFXV-BWvgRANG2rAR_cDewRt4T6CFpbNSvv70f40oYNiz4-KV9aUbRVS95A3x0Z25hUD8ACoGEOgM3jychTNOhfqDvskxSi1RT0jhhi5ptfvlGuDfz3otDfypDpJMOsU Jun 07 09:28:34.232391 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Domain-Id: None Jun 07 09:28:34.232391 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Domain-Name: None Jun 07 09:28:34.232391 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Identity-Status: Confirmed Jun 07 09:28:34.232391 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Is-Admin-Project: True Jun 07 09:28:34.232391 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Project-Domain-Id: default Jun 07 09:28:34.232391 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Project-Domain-Name: Default Jun 07 09:28:34.232391 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Project-Id: 4e297b1a418941c0a90839a6d7ed8f89 Jun 07 09:28:34.232391 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Project-Name: tempest-VolumesGetTestJSON-1350905772 Jun 07 09:28:34.232391 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Role: reader,member Jun 07 09:28:34.232391 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Roles: reader,member Jun 07 09:28:34.234271 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4e297b1a418941c0a90839a6d7ed8f89"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/4e297b1a418941c0a90839a6d7ed8f89"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_4e297b1a418941c0a90839a6d7ed8f89"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4e297b1a418941c0a90839a6d7ed8f89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 07 09:28:34.234271 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Tenant: tempest-VolumesGetTestJSON-1350905772 Jun 07 09:28:34.234271 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Tenant-Id: 4e297b1a418941c0a90839a6d7ed8f89 Jun 07 09:28:34.234271 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Tenant-Name: tempest-VolumesGetTestJSON-1350905772 Jun 07 09:28:34.234271 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User: tempest-VolumesGetTestJSON-1350905772-project Jun 07 09:28:34.234271 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User-Domain-Id: default Jun 07 09:28:34.234271 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User-Domain-Name: Default Jun 07 09:28:34.234271 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User-Id: b936366a1bc84badb0849df1c3fcc707 Jun 07 09:28:34.234271 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User-Name: tempest-VolumesGetTestJSON-1350905772-project Jun 07 09:28:34.234271 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: method: Jun 07 09:28:34.234271 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: exception: Volume e05a65b0-9d68-45cb-967f-1dfdeef5baea could not be found. Jun 07 09:28:34.234271 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: action_args: {'id': 'e05a65b0-9d68-45cb-967f-1dfdeef5baea'} Jun 07 09:28:34.234271 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 09:28:34.235044 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:28:34.235044 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 09:28:34.235044 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 09:28:34.235044 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 07 09:28:34.235044 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 07 09:28:34.235044 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 07 09:28:34.235044 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 07 09:28:34.235044 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 07 09:28:34.235044 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 07 09:28:34.235044 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 07 09:28:34.235044 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 07 09:28:34.235044 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 09:28:34.235044 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 09:28:34.235044 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 09:28:34.235044 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 09:28:34.235044 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e05a65b0-9d68-45cb-967f-1dfdeef5baea could not be found. (HTTP 404) (Request-ID: req-7fc7f7e5-d9f7-4ccf-a24b-2533975d3de7) Jun 07 09:28:34.235044 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:28:34.235044 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:28:34.235044 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:28:34.235922 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:28:34.235922 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 07 09:28:34.235922 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 07 09:28:34.235922 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 07 09:28:34.235922 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 07 09:28:34.235922 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 07 09:28:34.235922 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 07 09:28:34.235922 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 07 09:28:34.235922 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 07 09:28:34.235922 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 09:28:34.235922 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 09:28:34.235922 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 07 09:28:34.235922 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 07 09:28:34.235922 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 07 09:28:34.235922 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 07 09:28:34.235922 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 07 09:28:34.235922 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 07 09:28:34.235922 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 07 09:28:34.235922 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 07 09:28:34.236822 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 09:28:34.236822 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 09:28:34.236822 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 09:28:34.236822 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 09:28:34.236822 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e05a65b0-9d68-45cb-967f-1dfdeef5baea could not be found. Jun 07 09:28:34.236822 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:28:34.236822 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:28:34.236822 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:28:34.236822 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:28:34.236822 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:28:34.236822 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:28:34.236822 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 09:28:34.236822 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 09:28:34.236822 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 09:28:34.236822 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 09:28:34.236822 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 09:28:34.236822 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 09:28:34.236822 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 07 09:28:34.236822 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 09:28:34.237670 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e05a65b0-9d68-45cb-967f-1dfdeef5baea could not be found. Jun 07 09:28:34.237670 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:28:34.237670 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:28:34.237670 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:28:34.237670 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:28:34.237670 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:28:34.237670 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:28:34.237670 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 09:28:34.237670 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 09:28:34.237670 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e05a65b0-9d68-45cb-967f-1dfdeef5baea could not be found. Jun 07 09:28:34.237670 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:28:34.242557 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-8ce4f462-f719-4bc7-a377-f6ba3099acd6 tempest-VolumesGetTestJSON-1350905772 tempest-VolumesGetTestJSON-1350905772-project] Returning 404 to user: Volume e05a65b0-9d68-45cb-967f-1dfdeef5baea could not be found. {{(pid=118741) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 09:28:34.243613 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-8ce4f462-f719-4bc7-a377-f6ba3099acd6 tempest-VolumesGetTestJSON-1350905772 tempest-VolumesGetTestJSON-1350905772-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/e05a65b0-9d68-45cb-967f-1dfdeef5baea" status: 404 len: 109 microversion: 2.1 time: 0.084911 Jun 07 09:28:34.247877 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 21/41] 10.222.0.57 () {58 vars in 1244 bytes} [Tue Jun 7 09:28:34 2022] GET /compute/v2.1/os-volumes/e05a65b0-9d68-45cb-967f-1dfdeef5baea => generated 109 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 09:28:34.252110 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-97b27f7a-254e-4113-bde7-5d562e8d346b tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] 10.222.0.57 "GET /compute/v2.1/servers/90803094-e09d-4c65-9aba-88d612d0dafd" status: 200 len: 1274 microversion: 2.1 time: 0.380770 Jun 07 09:28:34.265675 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 21/42] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:28:33 2022] GET /compute/v2.1/servers/90803094-e09d-4c65-9aba-88d612d0dafd => generated 1274 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:28:34.269025 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-2452ecf6-921a-411a-8448-0bd00f7be649 tempest-VolumesSnapshotsTestJSON-777521591 tempest-VolumesSnapshotsTestJSON-777521591-project] Calling method '.version_select at 0x7f5c93370e50>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:28:34.362743 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-2452ecf6-921a-411a-8448-0bd00f7be649 tempest-VolumesSnapshotsTestJSON-777521591 tempest-VolumesSnapshotsTestJSON-777521591-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/a3b6e3ca-8553-4143-8b72-9490bb7ef933" status: 200 len: 286 microversion: 2.1 time: 0.113402 Jun 07 09:28:34.363513 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 22/43] 10.222.0.57 () {58 vars in 1250 bytes} [Tue Jun 7 09:28:34 2022] GET /compute/v2.1/os-snapshots/a3b6e3ca-8553-4143-8b72-9490bb7ef933 => generated 286 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:28:34.445581 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-375a50d7-4644-4870-b55c-a108eee150ce tempest-VolumesTestJSON-1111874569 tempest-VolumesTestJSON-1111874569-project] Calling method '.version_select at 0x7f5c93b483a0>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:28:34.545987 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-375a50d7-4644-4870-b55c-a108eee150ce tempest-VolumesTestJSON-1111874569 tempest-VolumesTestJSON-1111874569-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/3daa736a-91e4-444b-8724-679fa192bb95" status: 200 len: 350 microversion: 2.1 time: 0.104087 Jun 07 09:28:34.546760 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 22/44] 10.222.0.57 () {58 vars in 1244 bytes} [Tue Jun 7 09:28:34 2022] GET /compute/v2.1/os-volumes/3daa736a-91e4-444b-8724-679fa192bb95 => generated 350 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:28:34.558462 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-0e05d5a0-a974-4f43-a351-e075e081afaf tempest-VolumesTestJSON-1111874569 tempest-VolumesTestJSON-1111874569-project] Calling method '.version_select at 0x7f5c93370550>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:28:34.837900 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-0e05d5a0-a974-4f43-a351-e075e081afaf tempest-VolumesTestJSON-1111874569 tempest-VolumesTestJSON-1111874569-project] 10.222.0.57 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.283295 Jun 07 09:28:34.838634 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 23/45] 10.222.0.57 () {58 vars in 1133 bytes} [Tue Jun 7 09:28:34 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:28:34.852075 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-d0c2a181-9793-4c97-acfc-2ad2e844a713 tempest-VolumesTestJSON-1111874569 tempest-VolumesTestJSON-1111874569-project] Calling method '.version_select at 0x7f5c93b48040>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:28:35.083220 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-d0c2a181-9793-4c97-acfc-2ad2e844a713 tempest-VolumesTestJSON-1111874569 tempest-VolumesTestJSON-1111874569-project] 10.222.0.57 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.234851 Jun 07 09:28:35.092446 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 23/46] 10.222.0.57 () {58 vars in 1148 bytes} [Tue Jun 7 09:28:34 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:28:35.128660 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-ef1c3adf-a407-4b6c-8622-517579349ea8 tempest-VolumesTestJSON-1111874569 tempest-VolumesTestJSON-1111874569-project] Calling method '.version_select at 0x7f5c9332b8b0>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:28:35.291097 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-ef1c3adf-a407-4b6c-8622-517579349ea8 tempest-VolumesTestJSON-1111874569 tempest-VolumesTestJSON-1111874569-project] 10.222.0.57 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.197180 Jun 07 09:28:35.292300 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 24/47] 10.222.0.57 () {58 vars in 1133 bytes} [Tue Jun 7 09:28:35 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:28:35.297101 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-7435b448-18c1-46b9-8637-78e9da2b0181 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:28:35.297862 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-7435b448-18c1-46b9-8637-78e9da2b0181 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] [instance: 90803094-e09d-4c65-9aba-88d612d0dafd] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:28:35.316044 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-7435b448-18c1-46b9-8637-78e9da2b0181 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:35.316501 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-7435b448-18c1-46b9-8637-78e9da2b0181 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:35.321460 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-7435b448-18c1-46b9-8637-78e9da2b0181 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:35.327326 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-7435b448-18c1-46b9-8637-78e9da2b0181 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:35.700603 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-8684fe97-038c-422a-a927-47dc6123b526 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Action: 'create', calling method: .version_select at 0x7f5c93b51ca0>, body: {"keypair": {"name": "tempest-keypair-667598548", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDnTajeeur1WnHYuX8B0EtVOBolnXzr6JlHrHk6vTLPsXCOhhRIaKZhgfq1APUYp5b6LfTtyPIBJYISzlB18qJqu2BCSBJx4oIEwUpbl9tiRbppOxfstvmY8OGwJAiN1+g=="}} {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:28:35.735968 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.quota [None req-8684fe97-038c-422a-a927-47dc6123b526 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Getting quotas for project 50189b9cf3b145ba84495af8db63c41b. Resources: {'key_pairs'} {{(pid=118740) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 09:28:35.754777 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.quota [None req-8684fe97-038c-422a-a927-47dc6123b526 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Getting quotas for user 2f32356bb0bd4234ba817db581b62aad and project 50189b9cf3b145ba84495af8db63c41b. Resources: {'key_pairs'} {{(pid=118740) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 09:28:35.863523 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-7435b448-18c1-46b9-8637-78e9da2b0181 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9726e11bda974054a1e972c097b1ea1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986f0a9e430e4caaaed4affc2d4b8aeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:28:35.870115 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writing DB stats nova_cell0:SELECT=8 {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:28:35.876445 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-7435b448-18c1-46b9-8637-78e9da2b0181 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] 10.222.0.57 "GET /compute/v2.1/servers/90803094-e09d-4c65-9aba-88d612d0dafd" status: 200 len: 1272 microversion: 2.1 time: 0.582927 Jun 07 09:28:35.885825 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 25/48] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:28:35 2022] GET /compute/v2.1/servers/90803094-e09d-4c65-9aba-88d612d0dafd => generated 1272 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:28:35.903934 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-297ef389-b5d4-4fbf-a1d7-4c17b0d037a3 tempest-VolumesTestJSON-1111874569 tempest-VolumesTestJSON-1111874569-project] Calling method '.version_select at 0x7f5c932968b0>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:28:35.913378 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-8684fe97-038c-422a-a927-47dc6123b526 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.773882 Jun 07 09:28:35.914541 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 24/49] 10.222.0.57 () {60 vars in 1158 bytes} [Tue Jun 7 09:28:35 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:28:35.940064 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-9072548f-180a-4103-ac06-a5367b9baf4c tempest-VolumesSnapshotsTestJSON-777521591 tempest-VolumesSnapshotsTestJSON-777521591-project] Calling method '.version_select at 0x7f5c9447b9d0>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:28:36.044860 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.wsgi [None req-9072548f-180a-4103-ac06-a5367b9baf4c tempest-VolumesSnapshotsTestJSON-777521591 tempest-VolumesSnapshotsTestJSON-777521591-project] HTTP exception thrown: Snapshot a3b6e3ca-8553-4143-8b72-9490bb7ef933 could not be found. Jun 07 09:28:36.049580 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-9072548f-180a-4103-ac06-a5367b9baf4c tempest-VolumesSnapshotsTestJSON-777521591 tempest-VolumesSnapshotsTestJSON-777521591-project] Request method failure captured: Jun 07 09:28:36.049580 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: request: GET /compute/v2.1/os-snapshots/a3b6e3ca-8553-4143-8b72-9490bb7ef933 HTTP/1.1 Jun 07 09:28:36.049580 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Accept: application/json Jun 07 09:28:36.049580 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Accept-Encoding: identity Jun 07 09:28:36.049580 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Connection: close Jun 07 09:28:36.049580 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Content-Length: 0 Jun 07 09:28:36.049580 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Content-Type: application/json Jun 07 09:28:36.049580 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Host: 10.222.0.57 Jun 07 09:28:36.049580 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Openstack-System-Scope: None Jun 07 09:28:36.049580 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: User-Agent: python-urllib3/1.26.9 Jun 07 09:28:36.049580 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Auth-Token: gAAAAABinxozRGoRxHAXT0mxFaTjvmylpkV2pEkertGUI4UjJE9my1Hky4Q1V3Xc-iBK2KDERyVCnDInRSeen14Yyg3zocgdH8fbHQO86CcZpvgyt3jwutsdZwKj42GQsqjTzFeAh4soO-tqN3G9mIBieN1NtuB2fgPvK1sYYuPN0B2wihYbwNo Jun 07 09:28:36.049580 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Domain-Id: None Jun 07 09:28:36.049580 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Domain-Name: None Jun 07 09:28:36.049580 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Identity-Status: Confirmed Jun 07 09:28:36.049580 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Is-Admin-Project: True Jun 07 09:28:36.049580 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Domain-Id: default Jun 07 09:28:36.049580 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Domain-Name: Default Jun 07 09:28:36.049580 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Id: 02c52b4e82354dd5af2f6daa818b6753 Jun 07 09:28:36.049580 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-777521591 Jun 07 09:28:36.049580 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Role: reader,member Jun 07 09:28:36.049580 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Roles: reader,member Jun 07 09:28:36.050888 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/02c52b4e82354dd5af2f6daa818b6753"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/02c52b4e82354dd5af2f6daa818b6753"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_02c52b4e82354dd5af2f6daa818b6753"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/02c52b4e82354dd5af2f6daa818b6753"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 07 09:28:36.050888 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Tenant: tempest-VolumesSnapshotsTestJSON-777521591 Jun 07 09:28:36.050888 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Tenant-Id: 02c52b4e82354dd5af2f6daa818b6753 Jun 07 09:28:36.050888 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-777521591 Jun 07 09:28:36.050888 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User: tempest-VolumesSnapshotsTestJSON-777521591-project Jun 07 09:28:36.050888 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Domain-Id: default Jun 07 09:28:36.050888 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Domain-Name: Default Jun 07 09:28:36.050888 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Id: 9ea8a3d820c944248e7e4e5c4683e44e Jun 07 09:28:36.050888 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Name: tempest-VolumesSnapshotsTestJSON-777521591-project Jun 07 09:28:36.050888 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: method: Jun 07 09:28:36.050888 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: exception: Snapshot a3b6e3ca-8553-4143-8b72-9490bb7ef933 could not be found. Jun 07 09:28:36.050888 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: action_args: {'id': 'a3b6e3ca-8553-4143-8b72-9490bb7ef933'} Jun 07 09:28:36.050888 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 09:28:36.051633 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:28:36.051633 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 07 09:28:36.051633 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 07 09:28:36.051633 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 07 09:28:36.051633 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 07 09:28:36.051633 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 07 09:28:36.051633 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 07 09:28:36.051633 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 07 09:28:36.051633 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 07 09:28:36.051633 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 07 09:28:36.051633 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 07 09:28:36.051633 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 09:28:36.051633 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 09:28:36.051633 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 09:28:36.051633 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 09:28:36.051633 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot a3b6e3ca-8553-4143-8b72-9490bb7ef933 could not be found. (HTTP 404) (Request-ID: req-dc1f64db-65df-44fa-a2c7-7ab8682c2b78) Jun 07 09:28:36.051633 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:28:36.051633 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:28:36.052758 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:28:36.052758 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:28:36.052758 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 07 09:28:36.052758 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 07 09:28:36.052758 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 07 09:28:36.052758 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 07 09:28:36.052758 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 07 09:28:36.052758 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 07 09:28:36.052758 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 07 09:28:36.052758 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 07 09:28:36.052758 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 07 09:28:36.052758 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 07 09:28:36.052758 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 07 09:28:36.052758 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 07 09:28:36.052758 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 07 09:28:36.052758 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 07 09:28:36.052758 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 07 09:28:36.052758 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 07 09:28:36.052758 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 07 09:28:36.053838 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 07 09:28:36.053838 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 09:28:36.053838 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 09:28:36.053838 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 09:28:36.053838 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 09:28:36.053838 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot a3b6e3ca-8553-4143-8b72-9490bb7ef933 could not be found. Jun 07 09:28:36.053838 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:28:36.053838 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:28:36.053838 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:28:36.053838 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:28:36.053838 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:28:36.053838 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:28:36.053838 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 09:28:36.053838 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 09:28:36.053838 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 09:28:36.053838 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 09:28:36.053838 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 09:28:36.053838 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 09:28:36.053838 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 07 09:28:36.053838 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 09:28:36.054874 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot a3b6e3ca-8553-4143-8b72-9490bb7ef933 could not be found. Jun 07 09:28:36.054874 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:28:36.054874 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:28:36.054874 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:28:36.054874 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:28:36.054874 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:28:36.054874 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:28:36.054874 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 09:28:36.054874 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 09:28:36.054874 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot a3b6e3ca-8553-4143-8b72-9490bb7ef933 could not be found. Jun 07 09:28:36.054874 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:28:36.059222 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-9072548f-180a-4103-ac06-a5367b9baf4c tempest-VolumesSnapshotsTestJSON-777521591 tempest-VolumesSnapshotsTestJSON-777521591-project] Returning 404 to user: Snapshot a3b6e3ca-8553-4143-8b72-9490bb7ef933 could not be found. {{(pid=118740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 09:28:36.060259 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-9072548f-180a-4103-ac06-a5367b9baf4c tempest-VolumesSnapshotsTestJSON-777521591 tempest-VolumesSnapshotsTestJSON-777521591-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/a3b6e3ca-8553-4143-8b72-9490bb7ef933" status: 404 len: 111 microversion: 2.1 time: 0.144609 Jun 07 09:28:36.064618 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 25/50] 10.222.0.57 () {58 vars in 1250 bytes} [Tue Jun 7 09:28:35 2022] GET /compute/v2.1/os-snapshots/a3b6e3ca-8553-4143-8b72-9490bb7ef933 => generated 111 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 09:28:36.073623 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-6afa2ce8-f019-4f65-943d-a86f1e4370bc tempest-VolumesSnapshotsTestJSON-777521591 tempest-VolumesSnapshotsTestJSON-777521591-project] Calling method '.version_select at 0x7f5c93b670d0>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:28:36.245945 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-297ef389-b5d4-4fbf-a1d7-4c17b0d037a3 tempest-VolumesTestJSON-1111874569 tempest-VolumesTestJSON-1111874569-project] 10.222.0.57 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.352684 Jun 07 09:28:36.249894 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 26/51] 10.222.0.57 () {58 vars in 1166 bytes} [Tue Jun 7 09:28:35 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:28:36.270060 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-25a8a829-e070-419d-a128-ba5be801638b tempest-VolumesTestJSON-1111874569 tempest-VolumesTestJSON-1111874569-project] Calling method '.version_select at 0x7f5c932a2a60>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:28:36.428433 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-6afa2ce8-f019-4f65-943d-a86f1e4370bc tempest-VolumesSnapshotsTestJSON-777521591 tempest-VolumesSnapshotsTestJSON-777521591-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/2fc52df7-d952-4f14-a8cd-53764b51a098" status: 202 len: 0 microversion: 2.1 time: 0.358138 Jun 07 09:28:36.429815 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 26/52] 10.222.0.57 () {58 vars in 1247 bytes} [Tue Jun 7 09:28:36 2022] DELETE /compute/v2.1/os-volumes/2fc52df7-d952-4f14-a8cd-53764b51a098 => generated 0 bytes in 360 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 09:28:36.438619 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-3328e581-38aa-4533-939a-a6030060c9ad tempest-VolumesSnapshotsTestJSON-777521591 tempest-VolumesSnapshotsTestJSON-777521591-project] Calling method '.version_select at 0x7f5c93b67940>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:28:36.557171 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-3328e581-38aa-4533-939a-a6030060c9ad tempest-VolumesSnapshotsTestJSON-777521591 tempest-VolumesSnapshotsTestJSON-777521591-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/2fc52df7-d952-4f14-a8cd-53764b51a098" status: 200 len: 345 microversion: 2.1 time: 0.120328 Jun 07 09:28:36.557171 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 27/53] 10.222.0.57 () {58 vars in 1244 bytes} [Tue Jun 7 09:28:36 2022] GET /compute/v2.1/os-volumes/2fc52df7-d952-4f14-a8cd-53764b51a098 => generated 345 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:28:36.588812 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-25a8a829-e070-419d-a128-ba5be801638b tempest-VolumesTestJSON-1111874569 tempest-VolumesTestJSON-1111874569-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.332022 Jun 07 09:28:36.599186 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 27/54] 10.222.0.57 () {58 vars in 1169 bytes} [Tue Jun 7 09:28:36 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:28:36.607100 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-7117acaa-500f-4a22-bf35-6b385bcb4ee4 tempest-VolumesTestJSON-1111874569 tempest-VolumesTestJSON-1111874569-project] Calling method '.version_select at 0x7f5c93b67f70>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:28:36.903053 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-235d3d72-875e-4a4f-a6eb-cdbadbb6f4a4 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:28:36.904490 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-235d3d72-875e-4a4f-a6eb-cdbadbb6f4a4 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] [instance: 90803094-e09d-4c65-9aba-88d612d0dafd] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:28:36.921174 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-235d3d72-875e-4a4f-a6eb-cdbadbb6f4a4 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:36.930886 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-235d3d72-875e-4a4f-a6eb-cdbadbb6f4a4 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:36.931097 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-7117acaa-500f-4a22-bf35-6b385bcb4ee4 tempest-VolumesTestJSON-1111874569 tempest-VolumesTestJSON-1111874569-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.328394 Jun 07 09:28:36.931097 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 28/55] 10.222.0.57 () {58 vars in 1154 bytes} [Tue Jun 7 09:28:36 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:28:36.931260 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-235d3d72-875e-4a4f-a6eb-cdbadbb6f4a4 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:36.931615 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-235d3d72-875e-4a4f-a6eb-cdbadbb6f4a4 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:36.942630 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-bf97fa7a-5fa0-40f1-9700-fd4fc1ce7b86 tempest-VolumesTestJSON-1111874569 tempest-VolumesTestJSON-1111874569-project] Calling method '.version_select at 0x7f5c93b673a0>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:28:37.257182 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-bf97fa7a-5fa0-40f1-9700-fd4fc1ce7b86 tempest-VolumesTestJSON-1111874569 tempest-VolumesTestJSON-1111874569-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.319001 Jun 07 09:28:37.257747 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 29/56] 10.222.0.57 () {58 vars in 1187 bytes} [Tue Jun 7 09:28:36 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:28:37.272786 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-427b8743-e09a-4ddd-b0ae-b60b526cd5f2 tempest-VolumesTestJSON-1111874569 tempest-VolumesTestJSON-1111874569-project] Calling method '.version_select at 0x7f5c93acc790>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:28:37.587792 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-427b8743-e09a-4ddd-b0ae-b60b526cd5f2 tempest-VolumesTestJSON-1111874569 tempest-VolumesTestJSON-1111874569-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.321688 Jun 07 09:28:37.690273 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 30/57] 10.222.0.57 () {58 vars in 1154 bytes} [Tue Jun 7 09:28:37 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:28:37.690273 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-f1d1b5b7-9d6e-4f73-84e3-16d352439e9a tempest-VolumesSnapshotsTestJSON-777521591 tempest-VolumesSnapshotsTestJSON-777521591-project] Calling method '.version_select at 0x7f5c93acd4c0>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:28:37.690273 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.wsgi [None req-f1d1b5b7-9d6e-4f73-84e3-16d352439e9a tempest-VolumesSnapshotsTestJSON-777521591 tempest-VolumesSnapshotsTestJSON-777521591-project] HTTP exception thrown: Volume 2fc52df7-d952-4f14-a8cd-53764b51a098 could not be found. Jun 07 09:28:37.690273 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-f1d1b5b7-9d6e-4f73-84e3-16d352439e9a tempest-VolumesSnapshotsTestJSON-777521591 tempest-VolumesSnapshotsTestJSON-777521591-project] Request method failure captured: Jun 07 09:28:37.690273 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: request: GET /compute/v2.1/os-volumes/2fc52df7-d952-4f14-a8cd-53764b51a098 HTTP/1.1 Jun 07 09:28:37.690273 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Accept: application/json Jun 07 09:28:37.690273 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Accept-Encoding: identity Jun 07 09:28:37.690273 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Connection: close Jun 07 09:28:37.690273 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Content-Length: 0 Jun 07 09:28:37.690273 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Content-Type: application/json Jun 07 09:28:37.690273 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Host: 10.222.0.57 Jun 07 09:28:37.690273 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Openstack-System-Scope: None Jun 07 09:28:37.690273 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: User-Agent: python-urllib3/1.26.9 Jun 07 09:28:37.690273 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Auth-Token: gAAAAABinxozRGoRxHAXT0mxFaTjvmylpkV2pEkertGUI4UjJE9my1Hky4Q1V3Xc-iBK2KDERyVCnDInRSeen14Yyg3zocgdH8fbHQO86CcZpvgyt3jwutsdZwKj42GQsqjTzFeAh4soO-tqN3G9mIBieN1NtuB2fgPvK1sYYuPN0B2wihYbwNo Jun 07 09:28:37.690273 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Domain-Id: None Jun 07 09:28:37.690273 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Domain-Name: None Jun 07 09:28:37.690273 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Identity-Status: Confirmed Jun 07 09:28:37.690273 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Is-Admin-Project: True Jun 07 09:28:37.690273 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Domain-Id: default Jun 07 09:28:37.690273 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Domain-Name: Default Jun 07 09:28:37.690273 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Id: 02c52b4e82354dd5af2f6daa818b6753 Jun 07 09:28:37.690273 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-777521591 Jun 07 09:28:37.690273 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Role: reader,member Jun 07 09:28:37.690273 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Roles: reader,member Jun 07 09:28:37.693757 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/02c52b4e82354dd5af2f6daa818b6753"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/02c52b4e82354dd5af2f6daa818b6753"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_02c52b4e82354dd5af2f6daa818b6753"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/02c52b4e82354dd5af2f6daa818b6753"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 07 09:28:37.693757 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Tenant: tempest-VolumesSnapshotsTestJSON-777521591 Jun 07 09:28:37.693757 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Tenant-Id: 02c52b4e82354dd5af2f6daa818b6753 Jun 07 09:28:37.693757 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-777521591 Jun 07 09:28:37.693757 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User: tempest-VolumesSnapshotsTestJSON-777521591-project Jun 07 09:28:37.693757 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Domain-Id: default Jun 07 09:28:37.693757 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Domain-Name: Default Jun 07 09:28:37.693757 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Id: 9ea8a3d820c944248e7e4e5c4683e44e Jun 07 09:28:37.693757 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Name: tempest-VolumesSnapshotsTestJSON-777521591-project Jun 07 09:28:37.693757 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: method: Jun 07 09:28:37.693757 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: exception: Volume 2fc52df7-d952-4f14-a8cd-53764b51a098 could not be found. Jun 07 09:28:37.693757 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: action_args: {'id': '2fc52df7-d952-4f14-a8cd-53764b51a098'} Jun 07 09:28:37.693757 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 09:28:37.695522 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:28:37.695522 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 09:28:37.695522 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 09:28:37.695522 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 07 09:28:37.695522 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 07 09:28:37.695522 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 07 09:28:37.695522 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 07 09:28:37.695522 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 07 09:28:37.695522 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 07 09:28:37.695522 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 07 09:28:37.695522 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 07 09:28:37.695522 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 09:28:37.695522 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 09:28:37.695522 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 09:28:37.695522 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 09:28:37.695522 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2fc52df7-d952-4f14-a8cd-53764b51a098 could not be found. (HTTP 404) (Request-ID: req-7aca45e1-5a51-4654-9927-c572a9339012) Jun 07 09:28:37.695522 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:28:37.695522 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:28:37.695522 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:28:37.697708 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:28:37.697708 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 07 09:28:37.697708 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 07 09:28:37.697708 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 07 09:28:37.697708 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 07 09:28:37.697708 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 07 09:28:37.697708 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 07 09:28:37.697708 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 07 09:28:37.697708 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 07 09:28:37.697708 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 09:28:37.697708 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 09:28:37.697708 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 07 09:28:37.697708 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 07 09:28:37.697708 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 07 09:28:37.697708 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 07 09:28:37.697708 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 07 09:28:37.697708 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 07 09:28:37.697708 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 07 09:28:37.697708 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 07 09:28:37.699405 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 09:28:37.699405 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 09:28:37.699405 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 09:28:37.699405 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 09:28:37.699405 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2fc52df7-d952-4f14-a8cd-53764b51a098 could not be found. Jun 07 09:28:37.699405 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:28:37.699405 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:28:37.699405 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:28:37.699405 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:28:37.699405 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:28:37.699405 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:28:37.699405 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 09:28:37.699405 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 09:28:37.699405 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 09:28:37.699405 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 09:28:37.699405 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 09:28:37.699405 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 09:28:37.699405 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 07 09:28:37.699405 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 09:28:37.700681 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2fc52df7-d952-4f14-a8cd-53764b51a098 could not be found. Jun 07 09:28:37.700681 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:28:37.700681 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:28:37.700681 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:28:37.700681 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:28:37.700681 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:28:37.700681 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:28:37.700681 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 09:28:37.700681 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 09:28:37.700681 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2fc52df7-d952-4f14-a8cd-53764b51a098 could not be found. Jun 07 09:28:37.700681 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:28:37.700681 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-f1d1b5b7-9d6e-4f73-84e3-16d352439e9a tempest-VolumesSnapshotsTestJSON-777521591 tempest-VolumesSnapshotsTestJSON-777521591-project] Returning 404 to user: Volume 2fc52df7-d952-4f14-a8cd-53764b51a098 could not be found. {{(pid=118740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 09:28:37.700681 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-f1d1b5b7-9d6e-4f73-84e3-16d352439e9a tempest-VolumesSnapshotsTestJSON-777521591 tempest-VolumesSnapshotsTestJSON-777521591-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/2fc52df7-d952-4f14-a8cd-53764b51a098" status: 404 len: 109 microversion: 2.1 time: 0.057173 Jun 07 09:28:37.700681 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 31/58] 10.222.0.57 () {58 vars in 1244 bytes} [Tue Jun 7 09:28:37 2022] GET /compute/v2.1/os-volumes/2fc52df7-d952-4f14-a8cd-53764b51a098 => generated 109 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 09:28:37.715101 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-dc60c67b-07ae-4989-828c-e8816768d039 tempest-VolumesSnapshotsTestJSON-777521591 tempest-VolumesSnapshotsTestJSON-777521591-project] Calling method '.version_select at 0x7f5c93acc040>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:28:37.805319 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.wsgi [None req-dc60c67b-07ae-4989-828c-e8816768d039 tempest-VolumesSnapshotsTestJSON-777521591 tempest-VolumesSnapshotsTestJSON-777521591-project] HTTP exception thrown: Volume 2fc52df7-d952-4f14-a8cd-53764b51a098 could not be found. Jun 07 09:28:37.808666 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-dc60c67b-07ae-4989-828c-e8816768d039 tempest-VolumesSnapshotsTestJSON-777521591 tempest-VolumesSnapshotsTestJSON-777521591-project] Request method failure captured: Jun 07 09:28:37.808666 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: request: DELETE /compute/v2.1/os-volumes/2fc52df7-d952-4f14-a8cd-53764b51a098 HTTP/1.1 Jun 07 09:28:37.808666 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Accept: application/json Jun 07 09:28:37.808666 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Accept-Encoding: identity Jun 07 09:28:37.808666 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Connection: close Jun 07 09:28:37.808666 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Content-Length: 0 Jun 07 09:28:37.808666 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Content-Type: application/json Jun 07 09:28:37.808666 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Host: 10.222.0.57 Jun 07 09:28:37.808666 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Openstack-System-Scope: None Jun 07 09:28:37.808666 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: User-Agent: python-urllib3/1.26.9 Jun 07 09:28:37.808666 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Auth-Token: gAAAAABinxozRGoRxHAXT0mxFaTjvmylpkV2pEkertGUI4UjJE9my1Hky4Q1V3Xc-iBK2KDERyVCnDInRSeen14Yyg3zocgdH8fbHQO86CcZpvgyt3jwutsdZwKj42GQsqjTzFeAh4soO-tqN3G9mIBieN1NtuB2fgPvK1sYYuPN0B2wihYbwNo Jun 07 09:28:37.808666 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Domain-Id: None Jun 07 09:28:37.808666 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Domain-Name: None Jun 07 09:28:37.808666 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Identity-Status: Confirmed Jun 07 09:28:37.808666 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Is-Admin-Project: True Jun 07 09:28:37.808666 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Domain-Id: default Jun 07 09:28:37.808666 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Domain-Name: Default Jun 07 09:28:37.808666 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Id: 02c52b4e82354dd5af2f6daa818b6753 Jun 07 09:28:37.808666 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-777521591 Jun 07 09:28:37.808666 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Role: reader,member Jun 07 09:28:37.808666 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Roles: reader,member Jun 07 09:28:37.810098 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/02c52b4e82354dd5af2f6daa818b6753"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/02c52b4e82354dd5af2f6daa818b6753"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_02c52b4e82354dd5af2f6daa818b6753"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/02c52b4e82354dd5af2f6daa818b6753"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 07 09:28:37.810098 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Tenant: tempest-VolumesSnapshotsTestJSON-777521591 Jun 07 09:28:37.810098 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Tenant-Id: 02c52b4e82354dd5af2f6daa818b6753 Jun 07 09:28:37.810098 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-777521591 Jun 07 09:28:37.810098 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User: tempest-VolumesSnapshotsTestJSON-777521591-project Jun 07 09:28:37.810098 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Domain-Id: default Jun 07 09:28:37.810098 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Domain-Name: Default Jun 07 09:28:37.810098 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Id: 9ea8a3d820c944248e7e4e5c4683e44e Jun 07 09:28:37.810098 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Name: tempest-VolumesSnapshotsTestJSON-777521591-project Jun 07 09:28:37.810098 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: method: Jun 07 09:28:37.810098 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: exception: Volume 2fc52df7-d952-4f14-a8cd-53764b51a098 could not be found. Jun 07 09:28:37.810098 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: action_args: {'id': '2fc52df7-d952-4f14-a8cd-53764b51a098'} Jun 07 09:28:37.810098 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 09:28:37.811431 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:28:37.811431 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 09:28:37.811431 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 09:28:37.811431 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 07 09:28:37.811431 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 07 09:28:37.811431 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 07 09:28:37.811431 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 07 09:28:37.811431 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 07 09:28:37.811431 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 07 09:28:37.811431 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 07 09:28:37.811431 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 07 09:28:37.811431 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 09:28:37.811431 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 09:28:37.811431 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 09:28:37.811431 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 09:28:37.811431 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2fc52df7-d952-4f14-a8cd-53764b51a098 could not be found. (HTTP 404) (Request-ID: req-3fb339ed-ff04-4a2a-ba8a-cc39d0aee91d) Jun 07 09:28:37.811431 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:28:37.811431 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:28:37.811431 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:28:37.812697 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:28:37.812697 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 07 09:28:37.812697 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 07 09:28:37.812697 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 07 09:28:37.812697 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 07 09:28:37.812697 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 07 09:28:37.812697 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 07 09:28:37.812697 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 07 09:28:37.812697 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 07 09:28:37.812697 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 09:28:37.812697 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 09:28:37.812697 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 07 09:28:37.812697 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 07 09:28:37.812697 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 07 09:28:37.812697 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 07 09:28:37.812697 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 07 09:28:37.812697 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 07 09:28:37.812697 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 07 09:28:37.812697 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 07 09:28:37.813727 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 09:28:37.813727 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 09:28:37.813727 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 09:28:37.813727 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 09:28:37.813727 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2fc52df7-d952-4f14-a8cd-53764b51a098 could not be found. Jun 07 09:28:37.813727 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:28:37.813727 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:28:37.813727 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:28:37.813727 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:28:37.813727 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:28:37.813727 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:28:37.813727 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 09:28:37.813727 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 09:28:37.813727 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 09:28:37.813727 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 09:28:37.813727 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 09:28:37.813727 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 09:28:37.813727 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 07 09:28:37.813727 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 09:28:37.814716 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2fc52df7-d952-4f14-a8cd-53764b51a098 could not be found. Jun 07 09:28:37.814716 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:28:37.814716 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:28:37.814716 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:28:37.814716 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:28:37.814716 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:28:37.814716 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:28:37.814716 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 09:28:37.814716 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 09:28:37.814716 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2fc52df7-d952-4f14-a8cd-53764b51a098 could not be found. Jun 07 09:28:37.814716 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:28:37.816241 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-dc60c67b-07ae-4989-828c-e8816768d039 tempest-VolumesSnapshotsTestJSON-777521591 tempest-VolumesSnapshotsTestJSON-777521591-project] Returning 404 to user: Volume 2fc52df7-d952-4f14-a8cd-53764b51a098 could not be found. {{(pid=118740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 09:28:37.816727 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-dc60c67b-07ae-4989-828c-e8816768d039 tempest-VolumesSnapshotsTestJSON-777521591 tempest-VolumesSnapshotsTestJSON-777521591-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/2fc52df7-d952-4f14-a8cd-53764b51a098" status: 404 len: 109 microversion: 2.1 time: 0.118065 Jun 07 09:28:37.817723 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 32/59] 10.222.0.57 () {58 vars in 1247 bytes} [Tue Jun 7 09:28:37 2022] DELETE /compute/v2.1/os-volumes/2fc52df7-d952-4f14-a8cd-53764b51a098 => generated 109 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 09:28:37.839335 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-9549485b-e664-4233-8694-c660c3d45904 tempest-VolumesSnapshotsTestJSON-777521591 tempest-VolumesSnapshotsTestJSON-777521591-project] Calling method '.version_select at 0x7f5c93accd30>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:28:37.876265 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-235d3d72-875e-4a4f-a6eb-cdbadbb6f4a4 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9726e11bda974054a1e972c097b1ea1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986f0a9e430e4caaaed4affc2d4b8aeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:28:37.879358 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.wsgi [None req-9549485b-e664-4233-8694-c660c3d45904 tempest-VolumesSnapshotsTestJSON-777521591 tempest-VolumesSnapshotsTestJSON-777521591-project] HTTP exception thrown: Volume 2fc52df7-d952-4f14-a8cd-53764b51a098 could not be found. Jun 07 09:28:37.881484 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-9549485b-e664-4233-8694-c660c3d45904 tempest-VolumesSnapshotsTestJSON-777521591 tempest-VolumesSnapshotsTestJSON-777521591-project] Request method failure captured: Jun 07 09:28:37.881484 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: request: GET /compute/v2.1/os-volumes/2fc52df7-d952-4f14-a8cd-53764b51a098 HTTP/1.1 Jun 07 09:28:37.881484 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Accept: application/json Jun 07 09:28:37.881484 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Accept-Encoding: identity Jun 07 09:28:37.881484 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Connection: close Jun 07 09:28:37.881484 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Content-Length: 0 Jun 07 09:28:37.881484 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Content-Type: application/json Jun 07 09:28:37.881484 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Host: 10.222.0.57 Jun 07 09:28:37.881484 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Openstack-System-Scope: None Jun 07 09:28:37.881484 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: User-Agent: python-urllib3/1.26.9 Jun 07 09:28:37.881484 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Auth-Token: gAAAAABinxozRGoRxHAXT0mxFaTjvmylpkV2pEkertGUI4UjJE9my1Hky4Q1V3Xc-iBK2KDERyVCnDInRSeen14Yyg3zocgdH8fbHQO86CcZpvgyt3jwutsdZwKj42GQsqjTzFeAh4soO-tqN3G9mIBieN1NtuB2fgPvK1sYYuPN0B2wihYbwNo Jun 07 09:28:37.881484 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Domain-Id: None Jun 07 09:28:37.881484 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Domain-Name: None Jun 07 09:28:37.881484 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Identity-Status: Confirmed Jun 07 09:28:37.881484 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Is-Admin-Project: True Jun 07 09:28:37.881484 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Domain-Id: default Jun 07 09:28:37.881484 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Domain-Name: Default Jun 07 09:28:37.881484 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Id: 02c52b4e82354dd5af2f6daa818b6753 Jun 07 09:28:37.881484 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-777521591 Jun 07 09:28:37.881484 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Role: reader,member Jun 07 09:28:37.881484 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Roles: reader,member Jun 07 09:28:37.882727 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/02c52b4e82354dd5af2f6daa818b6753"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/02c52b4e82354dd5af2f6daa818b6753"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_02c52b4e82354dd5af2f6daa818b6753"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/02c52b4e82354dd5af2f6daa818b6753"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 07 09:28:37.882727 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Tenant: tempest-VolumesSnapshotsTestJSON-777521591 Jun 07 09:28:37.882727 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Tenant-Id: 02c52b4e82354dd5af2f6daa818b6753 Jun 07 09:28:37.882727 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-777521591 Jun 07 09:28:37.882727 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User: tempest-VolumesSnapshotsTestJSON-777521591-project Jun 07 09:28:37.882727 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Domain-Id: default Jun 07 09:28:37.882727 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Domain-Name: Default Jun 07 09:28:37.882727 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Id: 9ea8a3d820c944248e7e4e5c4683e44e Jun 07 09:28:37.882727 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Name: tempest-VolumesSnapshotsTestJSON-777521591-project Jun 07 09:28:37.882727 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: method: Jun 07 09:28:37.882727 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: exception: Volume 2fc52df7-d952-4f14-a8cd-53764b51a098 could not be found. Jun 07 09:28:37.882727 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: action_args: {'id': '2fc52df7-d952-4f14-a8cd-53764b51a098'} Jun 07 09:28:37.882727 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 09:28:37.883453 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:28:37.883453 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 09:28:37.883453 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 09:28:37.883453 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 07 09:28:37.883453 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 07 09:28:37.883453 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 07 09:28:37.883453 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 07 09:28:37.883453 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 07 09:28:37.883453 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 07 09:28:37.883453 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 07 09:28:37.883453 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 07 09:28:37.883453 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 09:28:37.883453 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 09:28:37.883453 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 09:28:37.883453 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 09:28:37.883453 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2fc52df7-d952-4f14-a8cd-53764b51a098 could not be found. (HTTP 404) (Request-ID: req-a2643e00-1d66-434b-82e1-6c74399687fe) Jun 07 09:28:37.883453 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:28:37.883453 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:28:37.883453 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:28:37.884532 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:28:37.884532 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 07 09:28:37.884532 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 07 09:28:37.884532 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 07 09:28:37.884532 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 07 09:28:37.884532 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 07 09:28:37.884532 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 07 09:28:37.884532 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 07 09:28:37.884532 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 07 09:28:37.884532 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 09:28:37.884532 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 09:28:37.884532 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 07 09:28:37.884532 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 07 09:28:37.884532 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 07 09:28:37.884532 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 07 09:28:37.884532 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 07 09:28:37.884532 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 07 09:28:37.884532 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 07 09:28:37.884532 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 07 09:28:37.885551 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 09:28:37.885551 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 09:28:37.885551 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 09:28:37.885551 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 09:28:37.885551 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2fc52df7-d952-4f14-a8cd-53764b51a098 could not be found. Jun 07 09:28:37.885551 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:28:37.885551 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:28:37.885551 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:28:37.885551 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:28:37.885551 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:28:37.885551 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:28:37.885551 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 09:28:37.885551 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 09:28:37.885551 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 09:28:37.885551 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 09:28:37.885551 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 09:28:37.885551 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 09:28:37.885551 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 07 09:28:37.885551 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 09:28:37.886538 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2fc52df7-d952-4f14-a8cd-53764b51a098 could not be found. Jun 07 09:28:37.886538 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:28:37.886538 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:28:37.886538 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:28:37.886538 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:28:37.886538 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:28:37.886538 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:28:37.886538 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 09:28:37.886538 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 09:28:37.886538 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2fc52df7-d952-4f14-a8cd-53764b51a098 could not be found. Jun 07 09:28:37.886538 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:28:37.889565 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-9549485b-e664-4233-8694-c660c3d45904 tempest-VolumesSnapshotsTestJSON-777521591 tempest-VolumesSnapshotsTestJSON-777521591-project] Returning 404 to user: Volume 2fc52df7-d952-4f14-a8cd-53764b51a098 could not be found. {{(pid=118740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 09:28:37.890546 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-9549485b-e664-4233-8694-c660c3d45904 tempest-VolumesSnapshotsTestJSON-777521591 tempest-VolumesSnapshotsTestJSON-777521591-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/2fc52df7-d952-4f14-a8cd-53764b51a098" status: 404 len: 109 microversion: 2.1 time: 0.068369 Jun 07 09:28:37.891558 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 33/60] 10.222.0.57 () {58 vars in 1244 bytes} [Tue Jun 7 09:28:37 2022] GET /compute/v2.1/os-volumes/2fc52df7-d952-4f14-a8cd-53764b51a098 => generated 109 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 07 09:28:37.900296 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-235d3d72-875e-4a4f-a6eb-cdbadbb6f4a4 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] 10.222.0.57 "GET /compute/v2.1/servers/90803094-e09d-4c65-9aba-88d612d0dafd" status: 200 len: 1272 microversion: 2.1 time: 0.997869 Jun 07 09:28:37.902064 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 28/61] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:28:36 2022] GET /compute/v2.1/servers/90803094-e09d-4c65-9aba-88d612d0dafd => generated 1272 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:28:38.915780 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-58660015-66d5-4f62-8372-6fa38b895b3a tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:28:38.917315 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-58660015-66d5-4f62-8372-6fa38b895b3a tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] [instance: 90803094-e09d-4c65-9aba-88d612d0dafd] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:28:38.944379 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-58660015-66d5-4f62-8372-6fa38b895b3a tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:38.944379 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-58660015-66d5-4f62-8372-6fa38b895b3a tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:38.944379 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-58660015-66d5-4f62-8372-6fa38b895b3a tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:38.944379 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-58660015-66d5-4f62-8372-6fa38b895b3a tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:39.513020 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-0993dacd-141c-4d7f-a3e7-0e0d0aba69b1 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Action: 'create', calling method: .version_select at 0x7f5c932b9310>, body: {"keypair": {"name": "tempest-keypair-56273524", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBACP3A6n9n7gO4QdLYs4ugOiNwJLWQM2h/WcZXk4LPgkxMp1hEQtOsz19cIHUrilYqpAEimTijnfXl/NPAbCLEzWWjmcVNnQpw3Dfzzcx7DB1rDm+C1x01sdLFXF4j2qrg=="}} {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:28:39.557764 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.quota [None req-0993dacd-141c-4d7f-a3e7-0e0d0aba69b1 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Getting quotas for project 61e2a8b0891548428759a52462a2feaa. Resources: {'key_pairs'} {{(pid=118741) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 09:28:39.565440 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.quota [None req-0993dacd-141c-4d7f-a3e7-0e0d0aba69b1 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Getting quotas for user 06e30bbe21af428faa5ec0eab414abf5 and project 61e2a8b0891548428759a52462a2feaa. Resources: {'key_pairs'} {{(pid=118741) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 09:28:39.721491 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-0993dacd-141c-4d7f-a3e7-0e0d0aba69b1 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.20 time: 0.605991 Jun 07 09:28:39.728247 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 29/62] 10.222.0.57 () {62 vars in 1199 bytes} [Tue Jun 7 09:28:39 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 608 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jun 07 09:28:40.021612 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-58660015-66d5-4f62-8372-6fa38b895b3a tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9726e11bda974054a1e972c097b1ea1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986f0a9e430e4caaaed4affc2d4b8aeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:28:40.034593 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-58660015-66d5-4f62-8372-6fa38b895b3a tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] 10.222.0.57 "GET /compute/v2.1/servers/90803094-e09d-4c65-9aba-88d612d0dafd" status: 200 len: 1314 microversion: 2.1 time: 1.123150 Jun 07 09:28:40.037863 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 34/63] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:28:38 2022] GET /compute/v2.1/servers/90803094-e09d-4c65-9aba-88d612d0dafd => generated 1314 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:28:40.268819 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-f34b5d6e-f016-471d-914c-8d331e9c6d55 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-204365445", "imageRef": "8fdb0275-8c58-4c9e-a2f3-3aae3a947526", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:28:40.356617 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.network.neutron [None req-f34b5d6e-f016-471d-914c-8d331e9c6d55 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] validate_networks() for [('45cdfca3-81fe-4f60-a7ce-397cbd865f9d', None, None, None, None, None)] {{(pid=118741) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 09:28:41.060700 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-f51abc92-9949-4bb9-b4d7-239eb7631a39 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:28:41.060700 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-f51abc92-9949-4bb9-b4d7-239eb7631a39 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] [instance: 90803094-e09d-4c65-9aba-88d612d0dafd] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:28:41.081728 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-f51abc92-9949-4bb9-b4d7-239eb7631a39 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:41.082879 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-f51abc92-9949-4bb9-b4d7-239eb7631a39 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:41.085327 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-f51abc92-9949-4bb9-b4d7-239eb7631a39 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:41.094849 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-f51abc92-9949-4bb9-b4d7-239eb7631a39 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:41.828546 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-f51abc92-9949-4bb9-b4d7-239eb7631a39 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9726e11bda974054a1e972c097b1ea1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986f0a9e430e4caaaed4affc2d4b8aeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:28:41.846303 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-f51abc92-9949-4bb9-b4d7-239eb7631a39 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] 10.222.0.57 "GET /compute/v2.1/servers/90803094-e09d-4c65-9aba-88d612d0dafd" status: 200 len: 1314 microversion: 2.1 time: 0.795723 Jun 07 09:28:41.851988 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 35/64] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:28:41 2022] GET /compute/v2.1/servers/90803094-e09d-4c65-9aba-88d612d0dafd => generated 1314 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:28:41.895361 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-9d33efb1-0dc0-46f2-9716-ad24542fb215 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-38034604", "imageRef": "8fdb0275-8c58-4c9e-a2f3-3aae3a947526", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bdba168b-b9af-45e6-8892-12f18759550b"}], "security_groups": [{"name": "tempest-securitygroup--1434385234"}], "key_name": "tempest-keypair-1834568858", "user_data": "}} {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:28:42.613125 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.network.neutron [None req-9d33efb1-0dc0-46f2-9716-ad24542fb215 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] validate_networks() for [('bdba168b-b9af-45e6-8892-12f18759550b', None, None, None, None, None)] {{(pid=118740) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 09:28:42.792222 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.virt.hardware [None req-f34b5d6e-f016-471d-914c-8d331e9c6d55 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Flavor limits 0:0:0 {{(pid=118741) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 09:28:42.792768 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.virt.hardware [None req-f34b5d6e-f016-471d-914c-8d331e9c6d55 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Image limits 0:0:0 {{(pid=118741) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 09:28:42.793548 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.virt.hardware [None req-f34b5d6e-f016-471d-914c-8d331e9c6d55 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Flavor pref 0:0:0 {{(pid=118741) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 09:28:42.795134 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.virt.hardware [None req-f34b5d6e-f016-471d-914c-8d331e9c6d55 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Image pref 0:0:0 {{(pid=118741) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 09:28:42.795725 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.virt.hardware [None req-f34b5d6e-f016-471d-914c-8d331e9c6d55 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118741) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 09:28:42.832025 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-f34b5d6e-f016-471d-914c-8d331e9c6d55 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:42.833340 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-f34b5d6e-f016-471d-914c-8d331e9c6d55 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:42.839437 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-f34b5d6e-f016-471d-914c-8d331e9c6d55 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:42.839897 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-f34b5d6e-f016-471d-914c-8d331e9c6d55 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:42.912926 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.quota [None req-f34b5d6e-f016-471d-914c-8d331e9c6d55 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Getting quotas for project 856d592872fa47a2b628f1c3e482b2fd. Resources: {'instances', 'cores', 'ram'} {{(pid=118741) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 09:28:42.926397 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.quota [None req-f34b5d6e-f016-471d-914c-8d331e9c6d55 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Getting quotas for user 75f6d2e28f024875bda0b20f751bdf0d and project 856d592872fa47a2b628f1c3e482b2fd. Resources: {'instances', 'cores', 'ram'} {{(pid=118741) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 09:28:42.980848 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-f34b5d6e-f016-471d-914c-8d331e9c6d55 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Going to run 1 instances... {{(pid=118741) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 09:28:42.984365 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-f34b5d6e-f016-471d-914c-8d331e9c6d55 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: 77d18a34-ad63-453f-9b17-517bd85a6f42] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8fdb0275-8c58-4c9e-a2f3-3aae3a947526',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118741) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 09:28:43.248788 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-f34b5d6e-f016-471d-914c-8d331e9c6d55 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.516337 Jun 07 09:28:43.252895 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 30/65] 10.222.0.57 () {60 vars in 1146 bytes} [Tue Jun 7 09:28:39 2022] POST /compute/v2.1/servers => generated 383 bytes in 3530 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 09:28:43.294661 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-c1ffd6ed-8e44-4f6f-b1ec-6131316ddf2f tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:28:43.299637 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-c1ffd6ed-8e44-4f6f-b1ec-6131316ddf2f tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] [instance: 90803094-e09d-4c65-9aba-88d612d0dafd] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:28:43.354236 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-c1ffd6ed-8e44-4f6f-b1ec-6131316ddf2f tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:43.354236 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-c1ffd6ed-8e44-4f6f-b1ec-6131316ddf2f tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:43.356780 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-c1ffd6ed-8e44-4f6f-b1ec-6131316ddf2f tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:43.357314 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-c1ffd6ed-8e44-4f6f-b1ec-6131316ddf2f tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:44.530611 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-c1ffd6ed-8e44-4f6f-b1ec-6131316ddf2f tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9726e11bda974054a1e972c097b1ea1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986f0a9e430e4caaaed4affc2d4b8aeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:28:44.541367 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-c1ffd6ed-8e44-4f6f-b1ec-6131316ddf2f tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] 10.222.0.57 "GET /compute/v2.1/servers/90803094-e09d-4c65-9aba-88d612d0dafd" status: 200 len: 1314 microversion: 2.1 time: 1.285589 Jun 07 09:28:44.546441 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 31/66] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:28:43 2022] GET /compute/v2.1/servers/90803094-e09d-4c65-9aba-88d612d0dafd => generated 1314 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:28:44.569300 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-608f4c43-0335-4e48-a861-61343ddcb706 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-218016343", "imageRef": "8fdb0275-8c58-4c9e-a2f3-3aae3a947526", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1c3e2e81-e169-4afa-8693-c0d0a9ba7610"}], "security_groups": [{"name": "tempest-securitygroup--1075071847"}], "key_name": "tempest-keypair-667598548", "user_data": "}} {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:28:45.389708 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.network.neutron [None req-608f4c43-0335-4e48-a861-61343ddcb706 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] validate_networks() for [('1c3e2e81-e169-4afa-8693-c0d0a9ba7610', None, None, None, None, None)] {{(pid=118741) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 09:28:45.776773 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writing DB stats nova_cell0:SELECT=10 {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:28:46.151004 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.virt.hardware [None req-9d33efb1-0dc0-46f2-9716-ad24542fb215 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Flavor limits 0:0:0 {{(pid=118740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 09:28:46.151437 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.virt.hardware [None req-9d33efb1-0dc0-46f2-9716-ad24542fb215 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Image limits 0:0:0 {{(pid=118740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 09:28:46.151915 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.virt.hardware [None req-9d33efb1-0dc0-46f2-9716-ad24542fb215 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Flavor pref 0:0:0 {{(pid=118740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 09:28:46.152327 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.virt.hardware [None req-9d33efb1-0dc0-46f2-9716-ad24542fb215 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Image pref 0:0:0 {{(pid=118740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 09:28:46.152826 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.virt.hardware [None req-9d33efb1-0dc0-46f2-9716-ad24542fb215 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 09:28:46.210571 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-9d33efb1-0dc0-46f2-9716-ad24542fb215 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:46.210571 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-9d33efb1-0dc0-46f2-9716-ad24542fb215 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:46.213555 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-9d33efb1-0dc0-46f2-9716-ad24542fb215 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:46.216036 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-9d33efb1-0dc0-46f2-9716-ad24542fb215 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:46.316644 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.quota [None req-9d33efb1-0dc0-46f2-9716-ad24542fb215 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Getting quotas for project 1c21b1cbbd604d6d9c97ab7c3c788f3d. Resources: {'instances', 'cores', 'ram'} {{(pid=118740) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 09:28:46.322222 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.quota [None req-9d33efb1-0dc0-46f2-9716-ad24542fb215 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Getting quotas for user 0346f4e3855142059983083e71c2c0c3 and project 1c21b1cbbd604d6d9c97ab7c3c788f3d. Resources: {'instances', 'cores', 'ram'} {{(pid=118740) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 09:28:46.376111 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-9d33efb1-0dc0-46f2-9716-ad24542fb215 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Going to run 1 instances... {{(pid=118740) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 09:28:46.381340 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-9d33efb1-0dc0-46f2-9716-ad24542fb215 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8fdb0275-8c58-4c9e-a2f3-3aae3a947526',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118740) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 09:28:46.730453 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-9d33efb1-0dc0-46f2-9716-ad24542fb215 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 4.876466 Jun 07 09:28:46.738241 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 36/67] 10.222.0.57 () {60 vars in 1146 bytes} [Tue Jun 7 09:28:41 2022] POST /compute/v2.1/servers => generated 402 bytes in 4886 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 09:28:46.744519 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-ce67603e-b88b-4bfe-a883-4c3e35aea521 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:28:46.747578 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-ce67603e-b88b-4bfe-a883-4c3e35aea521 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: 77d18a34-ad63-453f-9b17-517bd85a6f42] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:28:46.764215 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-ce67603e-b88b-4bfe-a883-4c3e35aea521 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:46.766435 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-ce67603e-b88b-4bfe-a883-4c3e35aea521 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:46.768128 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-ce67603e-b88b-4bfe-a883-4c3e35aea521 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:46.770305 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-ce67603e-b88b-4bfe-a883-4c3e35aea521 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:46.957884 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-ce67603e-b88b-4bfe-a883-4c3e35aea521 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:28:46.967684 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-ce67603e-b88b-4bfe-a883-4c3e35aea521 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/77d18a34-ad63-453f-9b17-517bd85a6f42" status: 200 len: 1225 microversion: 2.1 time: 0.227103 Jun 07 09:28:46.975535 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 37/68] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:28:46 2022] GET /compute/v2.1/servers/77d18a34-ad63-453f-9b17-517bd85a6f42 => generated 1225 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:28:46.995142 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-3f827212-3fc4-4761-857d-beaf5f926d7c tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:28:46.996231 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-3f827212-3fc4-4761-857d-beaf5f926d7c tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] [instance: 90803094-e09d-4c65-9aba-88d612d0dafd] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:28:47.021873 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-3f827212-3fc4-4761-857d-beaf5f926d7c tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:47.022428 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-3f827212-3fc4-4761-857d-beaf5f926d7c tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:47.031137 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-3f827212-3fc4-4761-857d-beaf5f926d7c tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:47.035291 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-3f827212-3fc4-4761-857d-beaf5f926d7c tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:47.635258 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-3f827212-3fc4-4761-857d-beaf5f926d7c tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9726e11bda974054a1e972c097b1ea1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986f0a9e430e4caaaed4affc2d4b8aeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:28:47.635258 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-3f827212-3fc4-4761-857d-beaf5f926d7c tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] 10.222.0.57 "GET /compute/v2.1/servers/90803094-e09d-4c65-9aba-88d612d0dafd" status: 200 len: 1314 microversion: 2.1 time: 0.657880 Jun 07 09:28:47.641248 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 38/69] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:28:46 2022] GET /compute/v2.1/servers/90803094-e09d-4c65-9aba-88d612d0dafd => generated 1314 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:28:48.087696 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.virt.hardware [None req-608f4c43-0335-4e48-a861-61343ddcb706 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Flavor limits 0:0:0 {{(pid=118741) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 09:28:48.089927 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.virt.hardware [None req-608f4c43-0335-4e48-a861-61343ddcb706 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Image limits 0:0:0 {{(pid=118741) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 09:28:48.090675 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.virt.hardware [None req-608f4c43-0335-4e48-a861-61343ddcb706 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Flavor pref 0:0:0 {{(pid=118741) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 09:28:48.092755 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.virt.hardware [None req-608f4c43-0335-4e48-a861-61343ddcb706 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Image pref 0:0:0 {{(pid=118741) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 09:28:48.093438 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.virt.hardware [None req-608f4c43-0335-4e48-a861-61343ddcb706 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118741) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 09:28:48.113946 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-608f4c43-0335-4e48-a861-61343ddcb706 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:48.114401 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-608f4c43-0335-4e48-a861-61343ddcb706 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:48.116844 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-608f4c43-0335-4e48-a861-61343ddcb706 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:48.125141 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-608f4c43-0335-4e48-a861-61343ddcb706 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:48.224502 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [req-46950007-c2f7-45c1-bfd0-94c44f8d0431 req-351c6185-ae43-4e10-b069-475871ea5c9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90803094-e09d-4c65-9aba-88d612d0dafd", "tag": "919af0e4-f81f-4aea-8fcf-3f4ce64021c4"}]} {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:28:48.234784 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.quota [None req-608f4c43-0335-4e48-a861-61343ddcb706 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Getting quotas for project 50189b9cf3b145ba84495af8db63c41b. Resources: {'instances', 'cores', 'ram'} {{(pid=118741) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 09:28:48.247299 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.quota [None req-608f4c43-0335-4e48-a861-61343ddcb706 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Getting quotas for user 2f32356bb0bd4234ba817db581b62aad and project 50189b9cf3b145ba84495af8db63c41b. Resources: {'instances', 'cores', 'ram'} {{(pid=118741) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 09:28:48.249519 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [req-46950007-c2f7-45c1-bfd0-94c44f8d0431 req-351c6185-ae43-4e10-b069-475871ea5c9c service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:48.251180 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [req-46950007-c2f7-45c1-bfd0-94c44f8d0431 req-351c6185-ae43-4e10-b069-475871ea5c9c service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:48.300852 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.compute.server_external_events [req-46950007-c2f7-45c1-bfd0-94c44f8d0431 req-351c6185-ae43-4e10-b069-475871ea5c9c service nova] Creating event network-changed:919af0e4-f81f-4aea-8fcf-3f4ce64021c4 for instance 90803094-e09d-4c65-9aba-88d612d0dafd on hv-cinder-83699 Jun 07 09:28:48.301746 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [req-46950007-c2f7-45c1-bfd0-94c44f8d0431 req-351c6185-ae43-4e10-b069-475871ea5c9c service nova] Acquired lock "compute-rpcapi-router" {{(pid=118740) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 07 09:28:48.302232 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-608f4c43-0335-4e48-a861-61343ddcb706 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Going to run 1 instances... {{(pid=118741) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 09:28:48.304054 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-c6705aea-b7c3-43be-9565-14517bd2e468 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:48.304870 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-c6705aea-b7c3-43be-9565-14517bd2e468 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:48.305930 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-c6705aea-b7c3-43be-9565-14517bd2e468 None None] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:48.306591 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-c6705aea-b7c3-43be-9565-14517bd2e468 None None] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:48.312179 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-608f4c43-0335-4e48-a861-61343ddcb706 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 0e41026b-9a96-47df-a158-d8ea485025bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8fdb0275-8c58-4c9e-a2f3-3aae3a947526',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118741) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 09:28:48.325212 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.compute.rpcapi [None req-c6705aea-b7c3-43be-9565-14517bd2e468 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 07 09:28:48.327052 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-c6705aea-b7c3-43be-9565-14517bd2e468 None None] Releasing lock "compute-rpcapi-router" {{(pid=118740) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 07 09:28:48.402913 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-c6705aea-b7c3-43be-9565-14517bd2e468 None None] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.759862 Jun 07 09:28:48.403853 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 39/70] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Jun 7 09:28:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:28:48.411677 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-7d88bae6-bc6a-4bcc-baac-1a5c1330df23 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:28:48.416697 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-7d88bae6-bc6a-4bcc-baac-1a5c1330df23 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:28:48.599588 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-608f4c43-0335-4e48-a861-61343ddcb706 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 4.047538 Jun 07 09:28:48.605172 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 32/71] 10.222.0.57 () {60 vars in 1146 bytes} [Tue Jun 7 09:28:44 2022] POST /compute/v2.1/servers => generated 402 bytes in 4057 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 09:28:48.614212 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-7d88bae6-bc6a-4bcc-baac-1a5c1330df23 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0346f4e3855142059983083e71c2c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c21b1cbbd604d6d9c97ab7c3c788f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:28:48.627670 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-7d88bae6-bc6a-4bcc-baac-1a5c1330df23 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25" status: 200 len: 1236 microversion: 2.1 time: 0.222155 Jun 07 09:28:48.629286 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 40/72] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:28:48 2022] GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 => generated 1236 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:28:48.639198 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-51e997a4-20f8-43f8-8083-a78003d57cbb tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1971912761", "imageRef": "8fdb0275-8c58-4c9e-a2f3-3aae3a947526", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f86a2e3c-ba66-428d-84ae-28da9b56628f"}], "security_groups": [{"name": "tempest-securitygroup--399111189"}], "key_name": "tempest-keypair-56273524", "user_data": "}} {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:28:48.657000 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-1104f229-231a-4621-8a7d-69aef32290af tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-494819625", "imageRef": "8fdb0275-8c58-4c9e-a2f3-3aae3a947526", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:28:48.898399 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.network.neutron [None req-1104f229-231a-4621-8a7d-69aef32290af tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] validate_networks() for [('45cdfca3-81fe-4f60-a7ce-397cbd865f9d', None, None, None, None, None)] {{(pid=118740) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 09:28:49.525862 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.network.neutron [None req-51e997a4-20f8-43f8-8083-a78003d57cbb tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] validate_networks() for [('f86a2e3c-ba66-428d-84ae-28da9b56628f', None, None, None, None, None)] {{(pid=118741) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 09:28:50.410483 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=10 {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:28:51.098402 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.virt.hardware [None req-1104f229-231a-4621-8a7d-69aef32290af tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Flavor limits 0:0:0 {{(pid=118740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 09:28:51.099024 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.virt.hardware [None req-1104f229-231a-4621-8a7d-69aef32290af tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Image limits 0:0:0 {{(pid=118740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 09:28:51.099543 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.virt.hardware [None req-1104f229-231a-4621-8a7d-69aef32290af tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Flavor pref 0:0:0 {{(pid=118740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 09:28:51.100233 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.virt.hardware [None req-1104f229-231a-4621-8a7d-69aef32290af tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Image pref 0:0:0 {{(pid=118740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 09:28:51.101411 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.virt.hardware [None req-1104f229-231a-4621-8a7d-69aef32290af tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 09:28:51.104596 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=5 {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:28:51.133899 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-1104f229-231a-4621-8a7d-69aef32290af tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:51.134639 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-1104f229-231a-4621-8a7d-69aef32290af tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:51.135771 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-1104f229-231a-4621-8a7d-69aef32290af tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:51.137670 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-1104f229-231a-4621-8a7d-69aef32290af tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:51.159351 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writing DB stats nova_cell1:SELECT=55 {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:28:51.190504 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.quota [None req-1104f229-231a-4621-8a7d-69aef32290af tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Getting quotas for project 856d592872fa47a2b628f1c3e482b2fd. Resources: {'instances', 'cores', 'ram'} {{(pid=118740) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 09:28:51.201636 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.virt.hardware [None req-51e997a4-20f8-43f8-8083-a78003d57cbb tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Flavor limits 0:0:0 {{(pid=118741) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 09:28:51.205261 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.virt.hardware [None req-51e997a4-20f8-43f8-8083-a78003d57cbb tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Image limits 0:0:0 {{(pid=118741) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 09:28:51.205261 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.virt.hardware [None req-51e997a4-20f8-43f8-8083-a78003d57cbb tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Flavor pref 0:0:0 {{(pid=118741) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 09:28:51.205261 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.virt.hardware [None req-51e997a4-20f8-43f8-8083-a78003d57cbb tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Image pref 0:0:0 {{(pid=118741) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 09:28:51.205261 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.virt.hardware [None req-51e997a4-20f8-43f8-8083-a78003d57cbb tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118741) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 09:28:51.208538 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.quota [None req-1104f229-231a-4621-8a7d-69aef32290af tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Getting quotas for user 75f6d2e28f024875bda0b20f751bdf0d and project 856d592872fa47a2b628f1c3e482b2fd. Resources: {'instances', 'cores', 'ram'} {{(pid=118740) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 09:28:51.219483 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-51e997a4-20f8-43f8-8083-a78003d57cbb tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:51.222137 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-51e997a4-20f8-43f8-8083-a78003d57cbb tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:51.224522 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-51e997a4-20f8-43f8-8083-a78003d57cbb tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:51.227940 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-51e997a4-20f8-43f8-8083-a78003d57cbb tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:51.231523 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-1104f229-231a-4621-8a7d-69aef32290af tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Going to run 1 instances... {{(pid=118740) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 09:28:51.237589 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-1104f229-231a-4621-8a7d-69aef32290af tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8fdb0275-8c58-4c9e-a2f3-3aae3a947526',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118740) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 09:28:51.240116 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writing DB stats nova_cell1:SELECT=37 {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:28:51.266888 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.quota [None req-51e997a4-20f8-43f8-8083-a78003d57cbb tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Getting quotas for project 61e2a8b0891548428759a52462a2feaa. Resources: {'instances', 'cores', 'ram'} {{(pid=118741) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 09:28:51.272009 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.quota [None req-51e997a4-20f8-43f8-8083-a78003d57cbb tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Getting quotas for user 06e30bbe21af428faa5ec0eab414abf5 and project 61e2a8b0891548428759a52462a2feaa. Resources: {'instances', 'cores', 'ram'} {{(pid=118741) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 09:28:51.285136 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-51e997a4-20f8-43f8-8083-a78003d57cbb tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Going to run 1 instances... {{(pid=118741) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 09:28:51.287747 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-51e997a4-20f8-43f8-8083-a78003d57cbb tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8fdb0275-8c58-4c9e-a2f3-3aae3a947526',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118741) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 09:28:51.466814 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-1104f229-231a-4621-8a7d-69aef32290af tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.836196 Jun 07 09:28:51.469518 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 41/73] 10.222.0.57 () {60 vars in 1146 bytes} [Tue Jun 7 09:28:48 2022] POST /compute/v2.1/servers => generated 383 bytes in 2840 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 09:28:51.486710 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-20d0a6be-8426-4c97-9286-dd0b832e3e1c tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:28:51.493080 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-20d0a6be-8426-4c97-9286-dd0b832e3e1c tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 0e41026b-9a96-47df-a158-d8ea485025bd] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:28:51.593039 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-51e997a4-20f8-43f8-8083-a78003d57cbb tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.981453 Jun 07 09:28:51.603353 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 33/74] 10.222.0.57 () {62 vars in 1187 bytes} [Tue Jun 7 09:28:48 2022] POST /compute/v2.1/servers => generated 401 bytes in 2998 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 07 09:28:51.610805 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-20d0a6be-8426-4c97-9286-dd0b832e3e1c tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:28:51.626205 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-20d0a6be-8426-4c97-9286-dd0b832e3e1c tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd" status: 200 len: 1240 microversion: 2.1 time: 0.149033 Jun 07 09:28:51.636551 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 42/75] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:28:51 2022] GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd => generated 1240 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:28:51.636675 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-b8e04b6a-20d3-4462-bb3b-639f3b513095 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:28:51.636675 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-b8e04b6a-20d3-4462-bb3b-639f3b513095 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] [instance: 90803094-e09d-4c65-9aba-88d612d0dafd] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:28:51.640896 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-a40837fc-c435-46e5-b27e-500cd2da743c tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:28:51.641518 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-a40837fc-c435-46e5-b27e-500cd2da743c tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:28:51.664827 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-a40837fc-c435-46e5-b27e-500cd2da743c tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:51.665296 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-a40837fc-c435-46e5-b27e-500cd2da743c tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:51.666088 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-a40837fc-c435-46e5-b27e-500cd2da743c tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:51.666560 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-a40837fc-c435-46e5-b27e-500cd2da743c tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:51.671725 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b8e04b6a-20d3-4462-bb3b-639f3b513095 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:51.672183 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b8e04b6a-20d3-4462-bb3b-639f3b513095 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:51.672994 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b8e04b6a-20d3-4462-bb3b-639f3b513095 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:51.673438 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b8e04b6a-20d3-4462-bb3b-639f3b513095 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:51.911724 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-a40837fc-c435-46e5-b27e-500cd2da743c tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0346f4e3855142059983083e71c2c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c21b1cbbd604d6d9c97ab7c3c788f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:28:51.937436 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-a40837fc-c435-46e5-b27e-500cd2da743c tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25" status: 200 len: 1288 microversion: 2.1 time: 0.308879 Jun 07 09:28:51.939937 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 43/76] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:28:51 2022] GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 => generated 1288 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:28:51.948087 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-e75b9b7b-428a-42b2-9462-e35a9d3256a0 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:28:51.949160 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-e75b9b7b-428a-42b2-9462-e35a9d3256a0 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:28:52.067226 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-e75b9b7b-428a-42b2-9462-e35a9d3256a0 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:28:52.091516 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-e75b9b7b-428a-42b2-9462-e35a9d3256a0 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4" status: 200 len: 1221 microversion: 2.1 time: 0.149886 Jun 07 09:28:52.095357 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 44/77] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:28:51 2022] GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4 => generated 1221 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:28:52.108470 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-651c6c24-8d73-4f71-b32f-7d4d91e3edba tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:28:52.127154 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-651c6c24-8d73-4f71-b32f-7d4d91e3edba tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:28:52.322943 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-651c6c24-8d73-4f71-b32f-7d4d91e3edba tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:28:52.330716 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-651c6c24-8d73-4f71-b32f-7d4d91e3edba tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:28:52.332723 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-651c6c24-8d73-4f71-b32f-7d4d91e3edba tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:28:52.339320 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-651c6c24-8d73-4f71-b32f-7d4d91e3edba tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1280 microversion: 2.20 time: 0.237707 Jun 07 09:28:52.345211 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 45/78] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:28:52 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1280 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:28:52.393827 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-b8e04b6a-20d3-4462-bb3b-639f3b513095 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9726e11bda974054a1e972c097b1ea1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986f0a9e430e4caaaed4affc2d4b8aeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:28:52.402745 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-b8e04b6a-20d3-4462-bb3b-639f3b513095 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] 10.222.0.57 "GET /compute/v2.1/servers/90803094-e09d-4c65-9aba-88d612d0dafd" status: 200 len: 1314 microversion: 2.1 time: 0.794560 Jun 07 09:28:52.406206 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 34/79] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:28:51 2022] GET /compute/v2.1/servers/90803094-e09d-4c65-9aba-88d612d0dafd => generated 1314 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:28:52.647255 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-38dddf25-9112-4b37-b098-61081f61b357 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:28:52.647255 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-38dddf25-9112-4b37-b098-61081f61b357 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 0e41026b-9a96-47df-a158-d8ea485025bd] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:28:52.674623 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-38dddf25-9112-4b37-b098-61081f61b357 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:52.676065 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-38dddf25-9112-4b37-b098-61081f61b357 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:52.676065 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-38dddf25-9112-4b37-b098-61081f61b357 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:52.676413 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-38dddf25-9112-4b37-b098-61081f61b357 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:52.936684 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-38dddf25-9112-4b37-b098-61081f61b357 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:28:52.954063 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-38dddf25-9112-4b37-b098-61081f61b357 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd" status: 200 len: 1236 microversion: 2.1 time: 0.314347 Jun 07 09:28:52.955294 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 46/80] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:28:52 2022] GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd => generated 1236 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:28:52.966073 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-b8151e96-d992-406e-a329-03be3ae40f63 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:28:52.966877 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-b8151e96-d992-406e-a329-03be3ae40f63 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:28:52.982914 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b8151e96-d992-406e-a329-03be3ae40f63 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:52.982914 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b8151e96-d992-406e-a329-03be3ae40f63 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:52.982914 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b8151e96-d992-406e-a329-03be3ae40f63 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:52.982914 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b8151e96-d992-406e-a329-03be3ae40f63 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:53.113431 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-be1218d1-8c67-4ad1-990d-587d99be7706 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:28:53.114736 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-be1218d1-8c67-4ad1-990d-587d99be7706 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:28:53.200417 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-b8151e96-d992-406e-a329-03be3ae40f63 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0346f4e3855142059983083e71c2c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c21b1cbbd604d6d9c97ab7c3c788f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:28:53.220054 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-b8151e96-d992-406e-a329-03be3ae40f63 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25" status: 200 len: 1294 microversion: 2.1 time: 0.262972 Jun 07 09:28:53.226664 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 35/81] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:28:52 2022] GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 => generated 1294 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:28:53.339413 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-be1218d1-8c67-4ad1-990d-587d99be7706 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:28:53.350350 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-be1218d1-8c67-4ad1-990d-587d99be7706 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4" status: 200 len: 1221 microversion: 2.1 time: 0.243373 Jun 07 09:28:53.350960 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 47/82] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:28:53 2022] GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4 => generated 1221 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:28:53.365392 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-61f736e4-f278-4741-80c4-30674624f5d8 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:28:53.366669 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-61f736e4-f278-4741-80c4-30674624f5d8 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:28:53.424359 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-03d58223-af5a-4a0a-8105-7138bd6fb0ac tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:28:53.425112 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-03d58223-af5a-4a0a-8105-7138bd6fb0ac tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] [instance: 90803094-e09d-4c65-9aba-88d612d0dafd] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:28:53.446742 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-03d58223-af5a-4a0a-8105-7138bd6fb0ac tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:53.446742 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-03d58223-af5a-4a0a-8105-7138bd6fb0ac tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:53.446742 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-03d58223-af5a-4a0a-8105-7138bd6fb0ac tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:53.446742 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-03d58223-af5a-4a0a-8105-7138bd6fb0ac tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:53.501168 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-61f736e4-f278-4741-80c4-30674624f5d8 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:28:53.513200 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-61f736e4-f278-4741-80c4-30674624f5d8 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:28:53.521822 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-61f736e4-f278-4741-80c4-30674624f5d8 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:28:53.524802 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-61f736e4-f278-4741-80c4-30674624f5d8 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1280 microversion: 2.20 time: 0.167481 Jun 07 09:28:53.534559 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 36/83] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:28:53 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1280 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 09:28:53.805859 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-03d58223-af5a-4a0a-8105-7138bd6fb0ac tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9726e11bda974054a1e972c097b1ea1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986f0a9e430e4caaaed4affc2d4b8aeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:28:53.817045 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-03d58223-af5a-4a0a-8105-7138bd6fb0ac tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] 10.222.0.57 "GET /compute/v2.1/servers/90803094-e09d-4c65-9aba-88d612d0dafd" status: 200 len: 1314 microversion: 2.1 time: 0.398038 Jun 07 09:28:53.818393 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 48/84] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:28:53 2022] GET /compute/v2.1/servers/90803094-e09d-4c65-9aba-88d612d0dafd => generated 1314 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:28:53.980374 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-24e51a37-f659-42f6-8f54-7e28f71687ea tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:28:53.984247 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-24e51a37-f659-42f6-8f54-7e28f71687ea tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 0e41026b-9a96-47df-a158-d8ea485025bd] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:28:54.020883 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-24e51a37-f659-42f6-8f54-7e28f71687ea tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:54.024496 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-24e51a37-f659-42f6-8f54-7e28f71687ea tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:54.026537 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-24e51a37-f659-42f6-8f54-7e28f71687ea tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:54.033096 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-24e51a37-f659-42f6-8f54-7e28f71687ea tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:54.152877 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-24e51a37-f659-42f6-8f54-7e28f71687ea tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:28:54.161446 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-24e51a37-f659-42f6-8f54-7e28f71687ea tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd" status: 200 len: 1292 microversion: 2.1 time: 0.191367 Jun 07 09:28:54.162032 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 37/85] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:28:53 2022] GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd => generated 1292 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:28:54.239355 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-3131a0c5-1455-430c-88a7-3a556698d99d tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:28:54.241553 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-3131a0c5-1455-430c-88a7-3a556698d99d tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:28:54.249468 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-3131a0c5-1455-430c-88a7-3a556698d99d tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:54.249999 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-3131a0c5-1455-430c-88a7-3a556698d99d tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:54.251189 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-3131a0c5-1455-430c-88a7-3a556698d99d tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:54.251699 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-3131a0c5-1455-430c-88a7-3a556698d99d tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:54.449648 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-3131a0c5-1455-430c-88a7-3a556698d99d tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0346f4e3855142059983083e71c2c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c21b1cbbd604d6d9c97ab7c3c788f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:28:54.458106 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-3131a0c5-1455-430c-88a7-3a556698d99d tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25" status: 200 len: 1362 microversion: 2.1 time: 0.223189 Jun 07 09:28:54.460801 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 49/86] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:28:54 2022] GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 => generated 1362 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:28:54.467037 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-4797cf23-3e74-4dfe-9f0f-108ffb371949 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:28:54.467955 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-4797cf23-3e74-4dfe-9f0f-108ffb371949 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:28:54.474382 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-4797cf23-3e74-4dfe-9f0f-108ffb371949 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:54.474989 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-4797cf23-3e74-4dfe-9f0f-108ffb371949 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:54.475882 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-4797cf23-3e74-4dfe-9f0f-108ffb371949 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:54.476422 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-4797cf23-3e74-4dfe-9f0f-108ffb371949 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:54.510389 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [req-4ef8e299-e74d-478a-b24f-1d67e50a8936 req-3a6d0594-b384-4b0f-b1cd-730b3c0e37f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77d18a34-ad63-453f-9b17-517bd85a6f42", "tag": "34b7939d-c0b3-49e3-ae23-f8bdfdcbb074"}]} {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:28:54.525809 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [req-4ef8e299-e74d-478a-b24f-1d67e50a8936 req-3a6d0594-b384-4b0f-b1cd-730b3c0e37f5 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:54.526469 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [req-4ef8e299-e74d-478a-b24f-1d67e50a8936 req-3a6d0594-b384-4b0f-b1cd-730b3c0e37f5 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:54.547263 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.compute.server_external_events [req-4ef8e299-e74d-478a-b24f-1d67e50a8936 req-3a6d0594-b384-4b0f-b1cd-730b3c0e37f5 service nova] Creating event network-changed:34b7939d-c0b3-49e3-ae23-f8bdfdcbb074 for instance 77d18a34-ad63-453f-9b17-517bd85a6f42 on hv-cinder-83699 Jun 07 09:28:54.547796 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [req-4ef8e299-e74d-478a-b24f-1d67e50a8936 req-3a6d0594-b384-4b0f-b1cd-730b3c0e37f5 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118741) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 07 09:28:54.549086 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-3fb79768-5d7c-4dcd-a064-838890c92075 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:54.549513 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-3fb79768-5d7c-4dcd-a064-838890c92075 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:54.550509 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-3fb79768-5d7c-4dcd-a064-838890c92075 None None] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:54.550969 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-3fb79768-5d7c-4dcd-a064-838890c92075 None None] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:54.559994 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.compute.rpcapi [None req-3fb79768-5d7c-4dcd-a064-838890c92075 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 07 09:28:54.561421 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-3fb79768-5d7c-4dcd-a064-838890c92075 None None] Releasing lock "compute-rpcapi-router" {{(pid=118741) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 07 09:28:54.568776 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-4797cf23-3e74-4dfe-9f0f-108ffb371949 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:28:54.577262 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-4797cf23-3e74-4dfe-9f0f-108ffb371949 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4" status: 200 len: 1225 microversion: 2.1 time: 0.115178 Jun 07 09:28:54.577834 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 50/87] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:28:54 2022] GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4 => generated 1225 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:28:54.594470 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-87d8fab3-c37f-46d6-8057-d259082cc76e tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:28:54.595086 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-87d8fab3-c37f-46d6-8057-d259082cc76e tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:28:54.598656 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-3fb79768-5d7c-4dcd-a064-838890c92075 None None] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.234288 Jun 07 09:28:54.603480 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 38/88] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Jun 7 09:28:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 09:28:54.611302 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-87d8fab3-c37f-46d6-8057-d259082cc76e tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:54.611753 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-87d8fab3-c37f-46d6-8057-d259082cc76e tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:54.612523 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-87d8fab3-c37f-46d6-8057-d259082cc76e tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:54.613008 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-87d8fab3-c37f-46d6-8057-d259082cc76e tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:54.677400 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-87d8fab3-c37f-46d6-8057-d259082cc76e tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:28:54.686125 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-87d8fab3-c37f-46d6-8057-d259082cc76e tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:28:54.689238 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-87d8fab3-c37f-46d6-8057-d259082cc76e tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:28:54.689238 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-87d8fab3-c37f-46d6-8057-d259082cc76e tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1284 microversion: 2.20 time: 0.110099 Jun 07 09:28:54.689789 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 51/89] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:28:54 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1284 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:28:54.835530 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-cf66082e-fa87-4f5d-8a7a-48566869c2e6 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:28:54.836255 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-cf66082e-fa87-4f5d-8a7a-48566869c2e6 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] [instance: 90803094-e09d-4c65-9aba-88d612d0dafd] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:28:54.842902 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-cf66082e-fa87-4f5d-8a7a-48566869c2e6 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:54.843347 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-cf66082e-fa87-4f5d-8a7a-48566869c2e6 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:54.844172 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-cf66082e-fa87-4f5d-8a7a-48566869c2e6 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:54.844625 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-cf66082e-fa87-4f5d-8a7a-48566869c2e6 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:54.974851 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-cf66082e-fa87-4f5d-8a7a-48566869c2e6 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9726e11bda974054a1e972c097b1ea1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986f0a9e430e4caaaed4affc2d4b8aeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:28:54.982583 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-cf66082e-fa87-4f5d-8a7a-48566869c2e6 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] 10.222.0.57 "GET /compute/v2.1/servers/90803094-e09d-4c65-9aba-88d612d0dafd" status: 200 len: 1314 microversion: 2.1 time: 0.151400 Jun 07 09:28:54.983147 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 39/90] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:28:54 2022] GET /compute/v2.1/servers/90803094-e09d-4c65-9aba-88d612d0dafd => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:28:55.180664 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-c563309f-4cf0-4365-b975-1992afbd8186 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:28:55.197924 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-c563309f-4cf0-4365-b975-1992afbd8186 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 0e41026b-9a96-47df-a158-d8ea485025bd] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:28:55.197924 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-c563309f-4cf0-4365-b975-1992afbd8186 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:55.197924 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-c563309f-4cf0-4365-b975-1992afbd8186 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:55.197924 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-c563309f-4cf0-4365-b975-1992afbd8186 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:55.199045 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-c563309f-4cf0-4365-b975-1992afbd8186 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:55.477481 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-7ef4fead-539f-4c24-84bd-4e92ab3c6be3 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:28:55.478450 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-7ef4fead-539f-4c24-84bd-4e92ab3c6be3 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:28:55.491367 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-7ef4fead-539f-4c24-84bd-4e92ab3c6be3 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:55.492006 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-7ef4fead-539f-4c24-84bd-4e92ab3c6be3 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:55.493136 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-7ef4fead-539f-4c24-84bd-4e92ab3c6be3 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:55.493575 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-7ef4fead-539f-4c24-84bd-4e92ab3c6be3 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:55.512309 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-c563309f-4cf0-4365-b975-1992afbd8186 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:28:55.519627 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-c563309f-4cf0-4365-b975-1992afbd8186 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd" status: 200 len: 1292 microversion: 2.1 time: 0.344314 Jun 07 09:28:55.528380 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 52/91] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:28:55 2022] GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd => generated 1292 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:28:55.601275 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-0a5e274c-e7d6-4b3b-a730-7d582d6875ae tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:28:55.601905 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-0a5e274c-e7d6-4b3b-a730-7d582d6875ae tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:28:55.608968 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-0a5e274c-e7d6-4b3b-a730-7d582d6875ae tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:55.609515 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-0a5e274c-e7d6-4b3b-a730-7d582d6875ae tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:55.610295 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-0a5e274c-e7d6-4b3b-a730-7d582d6875ae tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:55.610731 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-0a5e274c-e7d6-4b3b-a730-7d582d6875ae tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:55.700095 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-0a5e274c-e7d6-4b3b-a730-7d582d6875ae tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:28:55.710108 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-0a5e274c-e7d6-4b3b-a730-7d582d6875ae tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4" status: 200 len: 1217 microversion: 2.1 time: 0.113774 Jun 07 09:28:55.710690 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 53/92] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:28:55 2022] GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4 => generated 1217 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:28:55.715497 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-7f243c3a-bb9d-4201-a54a-d4ceb64cd8d1 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:28:55.716675 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-7f243c3a-bb9d-4201-a54a-d4ceb64cd8d1 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:28:55.723934 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-7f243c3a-bb9d-4201-a54a-d4ceb64cd8d1 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:55.724635 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-7f243c3a-bb9d-4201-a54a-d4ceb64cd8d1 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:55.725724 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-7f243c3a-bb9d-4201-a54a-d4ceb64cd8d1 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:55.726904 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-7f243c3a-bb9d-4201-a54a-d4ceb64cd8d1 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:55.748475 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-7ef4fead-539f-4c24-84bd-4e92ab3c6be3 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0346f4e3855142059983083e71c2c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c21b1cbbd604d6d9c97ab7c3c788f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:28:55.763151 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-7ef4fead-539f-4c24-84bd-4e92ab3c6be3 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25" status: 200 len: 1362 microversion: 2.1 time: 0.289704 Jun 07 09:28:55.772223 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 40/93] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:28:55 2022] GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 => generated 1362 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:28:55.813461 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-7f243c3a-bb9d-4201-a54a-d4ceb64cd8d1 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:28:55.823324 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-7f243c3a-bb9d-4201-a54a-d4ceb64cd8d1 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:28:55.825255 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-7f243c3a-bb9d-4201-a54a-d4ceb64cd8d1 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:28:55.827753 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-7f243c3a-bb9d-4201-a54a-d4ceb64cd8d1 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1276 microversion: 2.20 time: 0.116112 Jun 07 09:28:55.829142 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 54/94] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:28:55 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1276 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:28:56.000764 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-3f9f673f-2b7f-4eb1-98fb-5e8e7ede95d7 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:28:56.001532 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-3f9f673f-2b7f-4eb1-98fb-5e8e7ede95d7 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] [instance: 90803094-e09d-4c65-9aba-88d612d0dafd] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:28:56.007936 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-3f9f673f-2b7f-4eb1-98fb-5e8e7ede95d7 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:56.008379 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-3f9f673f-2b7f-4eb1-98fb-5e8e7ede95d7 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:56.009593 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-3f9f673f-2b7f-4eb1-98fb-5e8e7ede95d7 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:56.009671 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-3f9f673f-2b7f-4eb1-98fb-5e8e7ede95d7 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:56.054856 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [req-300e912c-541b-4c7a-bc35-e2fc4c324291 req-b2f15cf9-15c6-42c3-ab01-02a35e34f020 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25", "tag": "0d872428-4ab3-4d4f-845c-f8715f978155"}]} {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:28:56.065930 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [req-300e912c-541b-4c7a-bc35-e2fc4c324291 req-b2f15cf9-15c6-42c3-ab01-02a35e34f020 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:56.066383 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [req-300e912c-541b-4c7a-bc35-e2fc4c324291 req-b2f15cf9-15c6-42c3-ab01-02a35e34f020 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:56.081434 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.compute.server_external_events [req-300e912c-541b-4c7a-bc35-e2fc4c324291 req-b2f15cf9-15c6-42c3-ab01-02a35e34f020 service nova] Creating event network-changed:0d872428-4ab3-4d4f-845c-f8715f978155 for instance 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 on hv-cinder-83699 Jun 07 09:28:56.089193 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [req-300e912c-541b-4c7a-bc35-e2fc4c324291 req-b2f15cf9-15c6-42c3-ab01-02a35e34f020 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038499 Jun 07 09:28:56.089730 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 55/95] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Jun 7 09:28:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 09:28:56.383491 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-3f9f673f-2b7f-4eb1-98fb-5e8e7ede95d7 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9726e11bda974054a1e972c097b1ea1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986f0a9e430e4caaaed4affc2d4b8aeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:28:56.392093 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-3f9f673f-2b7f-4eb1-98fb-5e8e7ede95d7 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] 10.222.0.57 "GET /compute/v2.1/servers/90803094-e09d-4c65-9aba-88d612d0dafd" status: 200 len: 1314 microversion: 2.1 time: 0.396042 Jun 07 09:28:56.392754 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 41/96] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:28:55 2022] GET /compute/v2.1/servers/90803094-e09d-4c65-9aba-88d612d0dafd => generated 1314 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:28:56.539154 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-22729643-fed9-49c5-ae21-d67098a603d4 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:28:56.540420 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-22729643-fed9-49c5-ae21-d67098a603d4 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 0e41026b-9a96-47df-a158-d8ea485025bd] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:28:56.565770 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-22729643-fed9-49c5-ae21-d67098a603d4 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:56.565770 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-22729643-fed9-49c5-ae21-d67098a603d4 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:56.565770 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-22729643-fed9-49c5-ae21-d67098a603d4 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:56.565770 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-22729643-fed9-49c5-ae21-d67098a603d4 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:56.633279 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-22729643-fed9-49c5-ae21-d67098a603d4 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:28:56.641053 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-22729643-fed9-49c5-ae21-d67098a603d4 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd" status: 200 len: 1300 microversion: 2.1 time: 0.108015 Jun 07 09:28:56.641635 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 56/97] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:28:56 2022] GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd => generated 1300 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:28:56.727111 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-273fcf0a-db33-44cf-8421-237e6ab97705 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:28:56.727835 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-273fcf0a-db33-44cf-8421-237e6ab97705 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:28:56.734989 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-273fcf0a-db33-44cf-8421-237e6ab97705 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:56.735495 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-273fcf0a-db33-44cf-8421-237e6ab97705 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:56.737422 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-273fcf0a-db33-44cf-8421-237e6ab97705 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:56.737422 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-273fcf0a-db33-44cf-8421-237e6ab97705 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:56.784548 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-5f19da25-6b47-44a4-abf7-e107b35cc0d1 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:28:56.789173 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-5f19da25-6b47-44a4-abf7-e107b35cc0d1 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:28:56.797170 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-5f19da25-6b47-44a4-abf7-e107b35cc0d1 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:56.797907 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-5f19da25-6b47-44a4-abf7-e107b35cc0d1 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:56.798846 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-5f19da25-6b47-44a4-abf7-e107b35cc0d1 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:56.800725 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-5f19da25-6b47-44a4-abf7-e107b35cc0d1 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:56.806541 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-273fcf0a-db33-44cf-8421-237e6ab97705 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:28:56.815551 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-273fcf0a-db33-44cf-8421-237e6ab97705 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4" status: 200 len: 1217 microversion: 2.1 time: 0.092325 Jun 07 09:28:56.824807 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 42/98] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:28:56 2022] GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4 => generated 1217 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:28:56.847699 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-5b03b9f0-5693-45c0-afff-01cd1c193782 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:28:56.848576 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-5b03b9f0-5693-45c0-afff-01cd1c193782 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:28:56.855183 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-5b03b9f0-5693-45c0-afff-01cd1c193782 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:56.856069 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-5b03b9f0-5693-45c0-afff-01cd1c193782 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:56.857262 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-5b03b9f0-5693-45c0-afff-01cd1c193782 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:56.857697 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-5b03b9f0-5693-45c0-afff-01cd1c193782 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:56.927771 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-5b03b9f0-5693-45c0-afff-01cd1c193782 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:28:56.949094 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-5b03b9f0-5693-45c0-afff-01cd1c193782 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:28:56.949094 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-5b03b9f0-5693-45c0-afff-01cd1c193782 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:28:56.949094 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-5b03b9f0-5693-45c0-afff-01cd1c193782 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1276 microversion: 2.20 time: 0.097029 Jun 07 09:28:56.949394 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 43/99] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:28:56 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1276 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 09:28:56.949582 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-5f19da25-6b47-44a4-abf7-e107b35cc0d1 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0346f4e3855142059983083e71c2c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c21b1cbbd604d6d9c97ab7c3c788f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:28:56.959730 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-5f19da25-6b47-44a4-abf7-e107b35cc0d1 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25" status: 200 len: 1362 microversion: 2.1 time: 0.181067 Jun 07 09:28:56.960470 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 57/100] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:28:56 2022] GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 => generated 1362 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:28:57.409641 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-54888ae1-fb48-4022-b1ea-7343dd24be42 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:28:57.410249 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-54888ae1-fb48-4022-b1ea-7343dd24be42 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] [instance: 90803094-e09d-4c65-9aba-88d612d0dafd] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:28:57.416266 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-54888ae1-fb48-4022-b1ea-7343dd24be42 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:57.420452 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-54888ae1-fb48-4022-b1ea-7343dd24be42 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:57.420452 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-54888ae1-fb48-4022-b1ea-7343dd24be42 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:57.420452 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-54888ae1-fb48-4022-b1ea-7343dd24be42 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:57.550196 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-54888ae1-fb48-4022-b1ea-7343dd24be42 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9726e11bda974054a1e972c097b1ea1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986f0a9e430e4caaaed4affc2d4b8aeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:28:57.557722 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-54888ae1-fb48-4022-b1ea-7343dd24be42 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] 10.222.0.57 "GET /compute/v2.1/servers/90803094-e09d-4c65-9aba-88d612d0dafd" status: 200 len: 1314 microversion: 2.1 time: 0.151960 Jun 07 09:28:57.558281 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 44/101] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:28:57 2022] GET /compute/v2.1/servers/90803094-e09d-4c65-9aba-88d612d0dafd => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:28:57.658436 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-818d6659-9767-4f09-86a4-c7168768f1ff tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:28:57.659058 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-818d6659-9767-4f09-86a4-c7168768f1ff tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 0e41026b-9a96-47df-a158-d8ea485025bd] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:28:57.665065 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-818d6659-9767-4f09-86a4-c7168768f1ff tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:57.665519 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-818d6659-9767-4f09-86a4-c7168768f1ff tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:57.666283 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-818d6659-9767-4f09-86a4-c7168768f1ff tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:57.666720 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-818d6659-9767-4f09-86a4-c7168768f1ff tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:57.737798 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-818d6659-9767-4f09-86a4-c7168768f1ff tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:28:57.745225 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-818d6659-9767-4f09-86a4-c7168768f1ff tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd" status: 200 len: 1300 microversion: 2.1 time: 0.091296 Jun 07 09:28:57.745787 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 58/102] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:28:57 2022] GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd => generated 1300 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:28:57.833074 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-d017447b-c4b9-4140-8766-db579b41fd76 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:28:57.840364 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-d017447b-c4b9-4140-8766-db579b41fd76 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:28:57.840364 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-d017447b-c4b9-4140-8766-db579b41fd76 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:57.840364 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-d017447b-c4b9-4140-8766-db579b41fd76 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:57.841593 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-d017447b-c4b9-4140-8766-db579b41fd76 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:57.842103 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-d017447b-c4b9-4140-8766-db579b41fd76 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:57.935197 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-d017447b-c4b9-4140-8766-db579b41fd76 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:28:57.948287 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-d017447b-c4b9-4140-8766-db579b41fd76 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4" status: 200 len: 1217 microversion: 2.1 time: 0.118947 Jun 07 09:28:57.954109 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 45/103] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:28:57 2022] GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4 => generated 1217 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:28:57.969575 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-b2500bec-6190-46da-9f90-5c08a0d63230 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:28:57.976513 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-b2500bec-6190-46da-9f90-5c08a0d63230 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:28:57.993601 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b2500bec-6190-46da-9f90-5c08a0d63230 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:57.994061 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b2500bec-6190-46da-9f90-5c08a0d63230 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:57.994898 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b2500bec-6190-46da-9f90-5c08a0d63230 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:57.995339 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b2500bec-6190-46da-9f90-5c08a0d63230 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:58.001738 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-2542f0f9-2378-4f79-b8f6-fd75fd0c8f30 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:28:58.002581 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-2542f0f9-2378-4f79-b8f6-fd75fd0c8f30 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:28:58.029707 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-2542f0f9-2378-4f79-b8f6-fd75fd0c8f30 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:58.035354 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-2542f0f9-2378-4f79-b8f6-fd75fd0c8f30 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:58.038625 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-2542f0f9-2378-4f79-b8f6-fd75fd0c8f30 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:58.042174 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-2542f0f9-2378-4f79-b8f6-fd75fd0c8f30 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:58.302010 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-2542f0f9-2378-4f79-b8f6-fd75fd0c8f30 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0346f4e3855142059983083e71c2c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c21b1cbbd604d6d9c97ab7c3c788f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:28:58.310620 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-2542f0f9-2378-4f79-b8f6-fd75fd0c8f30 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25" status: 200 len: 1362 microversion: 2.1 time: 0.330042 Jun 07 09:28:58.311255 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 46/104] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:28:57 2022] GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 => generated 1362 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:28:58.319637 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-b2500bec-6190-46da-9f90-5c08a0d63230 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:28:58.328106 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-b2500bec-6190-46da-9f90-5c08a0d63230 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:28:58.329679 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-b2500bec-6190-46da-9f90-5c08a0d63230 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:28:58.348532 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-b2500bec-6190-46da-9f90-5c08a0d63230 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1276 microversion: 2.20 time: 0.372868 Jun 07 09:28:58.348532 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 59/105] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:28:57 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1276 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:28:58.574902 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-c4ee7905-071c-4a37-9649-35df0e308ee6 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:28:58.575763 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-c4ee7905-071c-4a37-9649-35df0e308ee6 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] [instance: 90803094-e09d-4c65-9aba-88d612d0dafd] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:28:58.583062 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-c4ee7905-071c-4a37-9649-35df0e308ee6 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:58.583510 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-c4ee7905-071c-4a37-9649-35df0e308ee6 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:58.584623 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-c4ee7905-071c-4a37-9649-35df0e308ee6 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:58.585287 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-c4ee7905-071c-4a37-9649-35df0e308ee6 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:58.764125 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-19a4f69f-0698-4d6c-b7f4-684787902d5d tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:28:58.765225 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-19a4f69f-0698-4d6c-b7f4-684787902d5d tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 0e41026b-9a96-47df-a158-d8ea485025bd] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:28:58.774786 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-19a4f69f-0698-4d6c-b7f4-684787902d5d tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:58.776307 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-19a4f69f-0698-4d6c-b7f4-684787902d5d tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:58.778674 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-19a4f69f-0698-4d6c-b7f4-684787902d5d tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:58.779466 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-19a4f69f-0698-4d6c-b7f4-684787902d5d tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:58.874926 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-19a4f69f-0698-4d6c-b7f4-684787902d5d tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:28:58.878594 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-c4ee7905-071c-4a37-9649-35df0e308ee6 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9726e11bda974054a1e972c097b1ea1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986f0a9e430e4caaaed4affc2d4b8aeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:28:58.884552 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-19a4f69f-0698-4d6c-b7f4-684787902d5d tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd" status: 200 len: 1298 microversion: 2.1 time: 0.125528 Jun 07 09:28:58.888159 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-c4ee7905-071c-4a37-9649-35df0e308ee6 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] 10.222.0.57 "GET /compute/v2.1/servers/90803094-e09d-4c65-9aba-88d612d0dafd" status: 200 len: 1314 microversion: 2.1 time: 0.317416 Jun 07 09:28:58.899492 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 47/106] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:28:58 2022] GET /compute/v2.1/servers/90803094-e09d-4c65-9aba-88d612d0dafd => generated 1314 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:28:58.900521 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 60/107] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:28:58 2022] GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd => generated 1298 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:28:58.972610 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-585ec4f5-db2d-49b3-ac1c-bd7449c0f3d5 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:28:58.973573 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-585ec4f5-db2d-49b3-ac1c-bd7449c0f3d5 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:28:58.982299 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-585ec4f5-db2d-49b3-ac1c-bd7449c0f3d5 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:58.986736 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-585ec4f5-db2d-49b3-ac1c-bd7449c0f3d5 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:58.988154 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-585ec4f5-db2d-49b3-ac1c-bd7449c0f3d5 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:58.989116 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-585ec4f5-db2d-49b3-ac1c-bd7449c0f3d5 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:59.098768 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-585ec4f5-db2d-49b3-ac1c-bd7449c0f3d5 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:28:59.108397 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-585ec4f5-db2d-49b3-ac1c-bd7449c0f3d5 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4" status: 200 len: 1273 microversion: 2.1 time: 0.140029 Jun 07 09:28:59.109486 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 48/108] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:28:58 2022] GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4 => generated 1273 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:28:59.328275 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-c029bbca-bd4d-4fe6-b782-a9f20c17a281 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:28:59.328978 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-c029bbca-bd4d-4fe6-b782-a9f20c17a281 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:28:59.335064 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-c029bbca-bd4d-4fe6-b782-a9f20c17a281 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:59.335583 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-c029bbca-bd4d-4fe6-b782-a9f20c17a281 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:59.336350 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-c029bbca-bd4d-4fe6-b782-a9f20c17a281 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:59.336823 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-c029bbca-bd4d-4fe6-b782-a9f20c17a281 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:59.356445 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-206a4d25-45ce-4660-82f9-3654069892b5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:28:59.358826 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-206a4d25-45ce-4660-82f9-3654069892b5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:28:59.368515 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-206a4d25-45ce-4660-82f9-3654069892b5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:59.368993 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-206a4d25-45ce-4660-82f9-3654069892b5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:59.369824 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-206a4d25-45ce-4660-82f9-3654069892b5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:59.373043 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-206a4d25-45ce-4660-82f9-3654069892b5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:59.492741 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-206a4d25-45ce-4660-82f9-3654069892b5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:28:59.502976 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-206a4d25-45ce-4660-82f9-3654069892b5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:28:59.504972 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-206a4d25-45ce-4660-82f9-3654069892b5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:28:59.506321 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-206a4d25-45ce-4660-82f9-3654069892b5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1332 microversion: 2.20 time: 0.155061 Jun 07 09:28:59.519729 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 49/109] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:28:59 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1332 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 09:28:59.559205 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-c029bbca-bd4d-4fe6-b782-a9f20c17a281 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0346f4e3855142059983083e71c2c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c21b1cbbd604d6d9c97ab7c3c788f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:28:59.568330 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-c029bbca-bd4d-4fe6-b782-a9f20c17a281 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25" status: 200 len: 1362 microversion: 2.1 time: 0.244635 Jun 07 09:28:59.578644 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 61/110] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:28:59 2022] GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 => generated 1362 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:28:59.902475 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-8bc2d0bb-4e46-423b-bc3a-0096515df5d6 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:28:59.903087 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-8bc2d0bb-4e46-423b-bc3a-0096515df5d6 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 0e41026b-9a96-47df-a158-d8ea485025bd] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:28:59.907441 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-fbb1809e-a17c-4d1f-b027-64f7c8584897 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:28:59.908614 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-fbb1809e-a17c-4d1f-b027-64f7c8584897 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] [instance: 90803094-e09d-4c65-9aba-88d612d0dafd] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:28:59.909768 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-8bc2d0bb-4e46-423b-bc3a-0096515df5d6 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:59.910223 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-8bc2d0bb-4e46-423b-bc3a-0096515df5d6 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:59.910989 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-8bc2d0bb-4e46-423b-bc3a-0096515df5d6 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:59.911423 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-8bc2d0bb-4e46-423b-bc3a-0096515df5d6 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:59.914711 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-fbb1809e-a17c-4d1f-b027-64f7c8584897 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:59.915166 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-fbb1809e-a17c-4d1f-b027-64f7c8584897 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:28:59.915929 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-fbb1809e-a17c-4d1f-b027-64f7c8584897 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:28:59.916366 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-fbb1809e-a17c-4d1f-b027-64f7c8584897 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:00.068414 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-fbb1809e-a17c-4d1f-b027-64f7c8584897 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9726e11bda974054a1e972c097b1ea1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986f0a9e430e4caaaed4affc2d4b8aeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:00.074231 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-8bc2d0bb-4e46-423b-bc3a-0096515df5d6 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:00.076903 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-fbb1809e-a17c-4d1f-b027-64f7c8584897 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] 10.222.0.57 "GET /compute/v2.1/servers/90803094-e09d-4c65-9aba-88d612d0dafd" status: 200 len: 1314 microversion: 2.1 time: 0.173600 Jun 07 09:29:00.077791 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 62/111] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:28:59 2022] GET /compute/v2.1/servers/90803094-e09d-4c65-9aba-88d612d0dafd => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:29:00.086140 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-8bc2d0bb-4e46-423b-bc3a-0096515df5d6 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd" status: 200 len: 1366 microversion: 2.1 time: 0.187505 Jun 07 09:29:00.086944 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 50/112] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:28:59 2022] GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd => generated 1366 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:00.126158 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-657e0dea-3dd1-4587-8549-b6565ebd011a tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:00.126769 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-657e0dea-3dd1-4587-8549-b6565ebd011a tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:00.135720 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-657e0dea-3dd1-4587-8549-b6565ebd011a tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:00.139103 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-657e0dea-3dd1-4587-8549-b6565ebd011a tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:00.139103 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-657e0dea-3dd1-4587-8549-b6565ebd011a tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:00.139103 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-657e0dea-3dd1-4587-8549-b6565ebd011a tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:00.142841 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writing DB stats nova_cell1:SELECT=100 {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:29:00.214072 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-657e0dea-3dd1-4587-8549-b6565ebd011a tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:00.225996 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-657e0dea-3dd1-4587-8549-b6565ebd011a tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4" status: 200 len: 1281 microversion: 2.1 time: 0.104176 Jun 07 09:29:00.226608 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 63/113] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:00 2022] GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4 => generated 1281 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:00.526195 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-07bc9f67-d715-4473-b7ef-467bf4e0b165 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:00.526806 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-07bc9f67-d715-4473-b7ef-467bf4e0b165 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:00.533465 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-07bc9f67-d715-4473-b7ef-467bf4e0b165 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:00.533918 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-07bc9f67-d715-4473-b7ef-467bf4e0b165 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:00.534679 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-07bc9f67-d715-4473-b7ef-467bf4e0b165 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:00.535116 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-07bc9f67-d715-4473-b7ef-467bf4e0b165 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:00.585139 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-e1a3befa-7c26-4de8-87cf-630f5ec7fd45 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:00.585761 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-e1a3befa-7c26-4de8-87cf-630f5ec7fd45 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:00.592554 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-e1a3befa-7c26-4de8-87cf-630f5ec7fd45 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:00.593045 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-e1a3befa-7c26-4de8-87cf-630f5ec7fd45 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:00.593904 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-e1a3befa-7c26-4de8-87cf-630f5ec7fd45 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:00.594346 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-e1a3befa-7c26-4de8-87cf-630f5ec7fd45 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:00.599581 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-07bc9f67-d715-4473-b7ef-467bf4e0b165 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:00.602109 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writing DB stats nova_cell1:SELECT=100 {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:29:00.609783 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-07bc9f67-d715-4473-b7ef-467bf4e0b165 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:00.612161 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-07bc9f67-d715-4473-b7ef-467bf4e0b165 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:00.613397 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-07bc9f67-d715-4473-b7ef-467bf4e0b165 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1340 microversion: 2.20 time: 0.091137 Jun 07 09:29:00.614044 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 51/114] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:29:00 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1340 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:29:00.767070 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-e1a3befa-7c26-4de8-87cf-630f5ec7fd45 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0346f4e3855142059983083e71c2c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c21b1cbbd604d6d9c97ab7c3c788f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:00.774499 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-e1a3befa-7c26-4de8-87cf-630f5ec7fd45 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25" status: 200 len: 1362 microversion: 2.1 time: 0.193377 Jun 07 09:29:00.775072 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 64/115] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:00 2022] GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 => generated 1362 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:29:01.093988 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-4fdc9e5a-1764-4d5f-8fbc-25a8a18d1481 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:01.094596 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-4fdc9e5a-1764-4d5f-8fbc-25a8a18d1481 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] [instance: 90803094-e09d-4c65-9aba-88d612d0dafd] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:01.100801 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-4fdc9e5a-1764-4d5f-8fbc-25a8a18d1481 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:01.101271 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-4fdc9e5a-1764-4d5f-8fbc-25a8a18d1481 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:01.108229 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-4fdc9e5a-1764-4d5f-8fbc-25a8a18d1481 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:01.108229 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-4fdc9e5a-1764-4d5f-8fbc-25a8a18d1481 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:01.108413 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-13f54d7b-4dd1-4fcf-8d63-858084295207 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:01.108413 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-13f54d7b-4dd1-4fcf-8d63-858084295207 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 0e41026b-9a96-47df-a158-d8ea485025bd] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:01.111884 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-13f54d7b-4dd1-4fcf-8d63-858084295207 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:01.112334 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-13f54d7b-4dd1-4fcf-8d63-858084295207 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:01.113204 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-13f54d7b-4dd1-4fcf-8d63-858084295207 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:01.113648 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-13f54d7b-4dd1-4fcf-8d63-858084295207 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:01.161169 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writing DB stats nova_cell0:SELECT=6 {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:29:01.251126 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-4fdc9e5a-1764-4d5f-8fbc-25a8a18d1481 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9726e11bda974054a1e972c097b1ea1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986f0a9e430e4caaaed4affc2d4b8aeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:01.258777 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-4fdc9e5a-1764-4d5f-8fbc-25a8a18d1481 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] 10.222.0.57 "GET /compute/v2.1/servers/90803094-e09d-4c65-9aba-88d612d0dafd" status: 200 len: 1314 microversion: 2.1 time: 0.169577 Jun 07 09:29:01.259346 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 52/116] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:01 2022] GET /compute/v2.1/servers/90803094-e09d-4c65-9aba-88d612d0dafd => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:01.265512 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-1d0a93e1-3d38-422a-a935-da36068d3328 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:01.266321 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-1d0a93e1-3d38-422a-a935-da36068d3328 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:01.273345 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-1d0a93e1-3d38-422a-a935-da36068d3328 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:01.273879 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-1d0a93e1-3d38-422a-a935-da36068d3328 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:01.274712 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-1d0a93e1-3d38-422a-a935-da36068d3328 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:01.275252 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-1d0a93e1-3d38-422a-a935-da36068d3328 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:01.291144 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-13f54d7b-4dd1-4fcf-8d63-858084295207 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:01.298854 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-13f54d7b-4dd1-4fcf-8d63-858084295207 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd" status: 200 len: 1366 microversion: 2.1 time: 0.198341 Jun 07 09:29:01.299422 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 65/117] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:01 2022] GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd => generated 1366 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:29:01.347109 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-1d0a93e1-3d38-422a-a935-da36068d3328 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:01.354708 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-1d0a93e1-3d38-422a-a935-da36068d3328 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4" status: 200 len: 1281 microversion: 2.1 time: 0.094124 Jun 07 09:29:01.355278 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 53/118] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:01 2022] GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4 => generated 1281 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:01.631717 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-405d4709-6402-496d-ae4d-00a98b00d7cc tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:01.632325 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-405d4709-6402-496d-ae4d-00a98b00d7cc tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:01.638868 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-405d4709-6402-496d-ae4d-00a98b00d7cc tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:01.639319 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-405d4709-6402-496d-ae4d-00a98b00d7cc tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:01.640077 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-405d4709-6402-496d-ae4d-00a98b00d7cc tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:01.640515 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-405d4709-6402-496d-ae4d-00a98b00d7cc tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:01.700102 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-405d4709-6402-496d-ae4d-00a98b00d7cc tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:01.708961 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-405d4709-6402-496d-ae4d-00a98b00d7cc tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:01.710671 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-405d4709-6402-496d-ae4d-00a98b00d7cc tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:01.711789 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-405d4709-6402-496d-ae4d-00a98b00d7cc tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1340 microversion: 2.20 time: 0.083945 Jun 07 09:29:01.712383 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 66/119] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:29:01 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1340 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:29:01.792628 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-3c259d63-195a-42e3-9669-ee873548ea3d tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:01.793308 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-3c259d63-195a-42e3-9669-ee873548ea3d tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:01.800551 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-3c259d63-195a-42e3-9669-ee873548ea3d tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:01.801061 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-3c259d63-195a-42e3-9669-ee873548ea3d tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:01.804335 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-3c259d63-195a-42e3-9669-ee873548ea3d tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:01.804335 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-3c259d63-195a-42e3-9669-ee873548ea3d tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:01.971826 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-3c259d63-195a-42e3-9669-ee873548ea3d tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0346f4e3855142059983083e71c2c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c21b1cbbd604d6d9c97ab7c3c788f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:01.979486 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-3c259d63-195a-42e3-9669-ee873548ea3d tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25" status: 200 len: 1362 microversion: 2.1 time: 0.190955 Jun 07 09:29:01.980070 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 54/120] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:01 2022] GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 => generated 1362 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:29:02.275263 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-e9fd5c0a-17ef-43b4-9fae-c9f848e64756 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:02.275890 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-e9fd5c0a-17ef-43b4-9fae-c9f848e64756 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] [instance: 90803094-e09d-4c65-9aba-88d612d0dafd] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:02.283358 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-e9fd5c0a-17ef-43b4-9fae-c9f848e64756 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:02.283841 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-e9fd5c0a-17ef-43b4-9fae-c9f848e64756 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:02.285032 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-e9fd5c0a-17ef-43b4-9fae-c9f848e64756 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:02.285537 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-e9fd5c0a-17ef-43b4-9fae-c9f848e64756 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:02.317440 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-ef28cde8-7741-4137-8ade-8de38934b15e tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:02.318108 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-ef28cde8-7741-4137-8ade-8de38934b15e tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 0e41026b-9a96-47df-a158-d8ea485025bd] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:02.324000 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-ef28cde8-7741-4137-8ade-8de38934b15e tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:02.324457 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-ef28cde8-7741-4137-8ade-8de38934b15e tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:02.325247 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-ef28cde8-7741-4137-8ade-8de38934b15e tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:02.325679 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-ef28cde8-7741-4137-8ade-8de38934b15e tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:02.464704 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-ef28cde8-7741-4137-8ade-8de38934b15e tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:02.474911 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-ef28cde8-7741-4137-8ade-8de38934b15e tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd" status: 200 len: 1366 microversion: 2.1 time: 0.161270 Jun 07 09:29:02.475821 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 55/121] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:02 2022] GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:29:02.482914 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-b5522a0f-05aa-4737-8bb0-5175a36caeeb tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:02.484058 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-b5522a0f-05aa-4737-8bb0-5175a36caeeb tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:02.491475 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b5522a0f-05aa-4737-8bb0-5175a36caeeb tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:02.491988 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b5522a0f-05aa-4737-8bb0-5175a36caeeb tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:02.492812 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b5522a0f-05aa-4737-8bb0-5175a36caeeb tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:02.493247 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b5522a0f-05aa-4737-8bb0-5175a36caeeb tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:02.594455 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-e9fd5c0a-17ef-43b4-9fae-c9f848e64756 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9726e11bda974054a1e972c097b1ea1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986f0a9e430e4caaaed4affc2d4b8aeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:02.602729 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-e9fd5c0a-17ef-43b4-9fae-c9f848e64756 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] 10.222.0.57 "GET /compute/v2.1/servers/90803094-e09d-4c65-9aba-88d612d0dafd" status: 200 len: 1314 microversion: 2.1 time: 0.331203 Jun 07 09:29:02.613561 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 67/122] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:02 2022] GET /compute/v2.1/servers/90803094-e09d-4c65-9aba-88d612d0dafd => generated 1314 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:02.708155 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-b5522a0f-05aa-4737-8bb0-5175a36caeeb tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:02.715676 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-b5522a0f-05aa-4737-8bb0-5175a36caeeb tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4" status: 200 len: 1281 microversion: 2.1 time: 0.238294 Jun 07 09:29:02.716303 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 56/123] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:02 2022] GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4 => generated 1281 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:02.729449 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-b3a3d856-ff31-46b3-853c-c4f0a1a31eec tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:02.730060 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-b3a3d856-ff31-46b3-853c-c4f0a1a31eec tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:02.737333 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b3a3d856-ff31-46b3-853c-c4f0a1a31eec tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:02.737785 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b3a3d856-ff31-46b3-853c-c4f0a1a31eec tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:02.738574 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b3a3d856-ff31-46b3-853c-c4f0a1a31eec tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:02.738991 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b3a3d856-ff31-46b3-853c-c4f0a1a31eec tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:02.798440 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-b3a3d856-ff31-46b3-853c-c4f0a1a31eec tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:02.806509 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-b3a3d856-ff31-46b3-853c-c4f0a1a31eec tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:02.808117 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-b3a3d856-ff31-46b3-853c-c4f0a1a31eec tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:02.809295 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-b3a3d856-ff31-46b3-853c-c4f0a1a31eec tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1340 microversion: 2.20 time: 0.083758 Jun 07 09:29:02.810411 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 68/124] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:29:02 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1340 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:29:02.999367 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-f95c1631-4345-4e0d-ad36-09dc4b236e3c tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:03.001892 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-f95c1631-4345-4e0d-ad36-09dc4b236e3c tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:03.006428 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-f95c1631-4345-4e0d-ad36-09dc4b236e3c tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:03.006880 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-f95c1631-4345-4e0d-ad36-09dc4b236e3c tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:03.007647 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-f95c1631-4345-4e0d-ad36-09dc4b236e3c tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:03.008138 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-f95c1631-4345-4e0d-ad36-09dc4b236e3c tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:03.139816 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-f95c1631-4345-4e0d-ad36-09dc4b236e3c tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0346f4e3855142059983083e71c2c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c21b1cbbd604d6d9c97ab7c3c788f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:03.147128 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-f95c1631-4345-4e0d-ad36-09dc4b236e3c tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25" status: 200 len: 1362 microversion: 2.1 time: 0.153666 Jun 07 09:29:03.147691 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 57/125] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:02 2022] GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:03.492823 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-71eacd5a-93af-4cc4-8fef-a5b1825ae7e8 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:03.493442 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-71eacd5a-93af-4cc4-8fef-a5b1825ae7e8 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 0e41026b-9a96-47df-a158-d8ea485025bd] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:03.495268 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writing DB stats nova_cell0:SELECT=22 {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:29:03.500222 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-71eacd5a-93af-4cc4-8fef-a5b1825ae7e8 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:03.500737 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-71eacd5a-93af-4cc4-8fef-a5b1825ae7e8 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:03.501508 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-71eacd5a-93af-4cc4-8fef-a5b1825ae7e8 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:03.501950 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-71eacd5a-93af-4cc4-8fef-a5b1825ae7e8 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:03.621321 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-e38a2b18-8101-4c3b-abc3-f1057dd29135 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:03.621928 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-e38a2b18-8101-4c3b-abc3-f1057dd29135 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] [instance: 90803094-e09d-4c65-9aba-88d612d0dafd] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:03.623973 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writing DB stats nova_cell0:SELECT=24 {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:29:03.629414 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-e38a2b18-8101-4c3b-abc3-f1057dd29135 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:03.629772 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-e38a2b18-8101-4c3b-abc3-f1057dd29135 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:03.630698 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-e38a2b18-8101-4c3b-abc3-f1057dd29135 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:03.631150 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-e38a2b18-8101-4c3b-abc3-f1057dd29135 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:03.646759 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-71eacd5a-93af-4cc4-8fef-a5b1825ae7e8 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:03.655416 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-71eacd5a-93af-4cc4-8fef-a5b1825ae7e8 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd" status: 200 len: 1366 microversion: 2.1 time: 0.166380 Jun 07 09:29:03.656220 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 69/126] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:03 2022] GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:03.731268 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-437be81f-9cfd-4d72-9fb9-46b659a36973 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:03.732177 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-437be81f-9cfd-4d72-9fb9-46b659a36973 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:03.738524 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-437be81f-9cfd-4d72-9fb9-46b659a36973 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:03.739163 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-437be81f-9cfd-4d72-9fb9-46b659a36973 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:03.740095 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-437be81f-9cfd-4d72-9fb9-46b659a36973 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:03.752319 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-437be81f-9cfd-4d72-9fb9-46b659a36973 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:03.774244 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-e38a2b18-8101-4c3b-abc3-f1057dd29135 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9726e11bda974054a1e972c097b1ea1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986f0a9e430e4caaaed4affc2d4b8aeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:03.782230 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-e38a2b18-8101-4c3b-abc3-f1057dd29135 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] 10.222.0.57 "GET /compute/v2.1/servers/90803094-e09d-4c65-9aba-88d612d0dafd" status: 200 len: 1314 microversion: 2.1 time: 0.164692 Jun 07 09:29:03.782983 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 58/127] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:03 2022] GET /compute/v2.1/servers/90803094-e09d-4c65-9aba-88d612d0dafd => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:29:03.805430 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-437be81f-9cfd-4d72-9fb9-46b659a36973 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:03.812918 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-437be81f-9cfd-4d72-9fb9-46b659a36973 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4" status: 200 len: 1281 microversion: 2.1 time: 0.085529 Jun 07 09:29:03.813780 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 70/128] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:03 2022] GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4 => generated 1281 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:29:03.827443 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-1847a0e9-ca09-4bbb-9ea6-0e23f10157e5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:03.828120 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-1847a0e9-ca09-4bbb-9ea6-0e23f10157e5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:03.834186 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-1847a0e9-ca09-4bbb-9ea6-0e23f10157e5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:03.834703 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-1847a0e9-ca09-4bbb-9ea6-0e23f10157e5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:03.835525 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-1847a0e9-ca09-4bbb-9ea6-0e23f10157e5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:03.835960 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-1847a0e9-ca09-4bbb-9ea6-0e23f10157e5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:03.900501 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-1847a0e9-ca09-4bbb-9ea6-0e23f10157e5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:03.909019 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-1847a0e9-ca09-4bbb-9ea6-0e23f10157e5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:03.910504 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-1847a0e9-ca09-4bbb-9ea6-0e23f10157e5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:03.911585 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-1847a0e9-ca09-4bbb-9ea6-0e23f10157e5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1340 microversion: 2.20 time: 0.088006 Jun 07 09:29:03.912219 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 59/129] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:29:03 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1340 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:29:04.163660 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-172c4761-fa09-460e-92db-2b53619e6884 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:04.164405 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-172c4761-fa09-460e-92db-2b53619e6884 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:04.171805 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-172c4761-fa09-460e-92db-2b53619e6884 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:04.172259 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-172c4761-fa09-460e-92db-2b53619e6884 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:04.173089 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-172c4761-fa09-460e-92db-2b53619e6884 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:04.173534 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-172c4761-fa09-460e-92db-2b53619e6884 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:04.300007 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-172c4761-fa09-460e-92db-2b53619e6884 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0346f4e3855142059983083e71c2c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c21b1cbbd604d6d9c97ab7c3c788f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:04.308090 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-172c4761-fa09-460e-92db-2b53619e6884 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25" status: 200 len: 1362 microversion: 2.1 time: 0.148071 Jun 07 09:29:04.309090 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 71/130] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:04 2022] GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:04.672414 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-b5682409-258a-402f-be0b-abfa5c501b80 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:04.673083 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-b5682409-258a-402f-be0b-abfa5c501b80 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 0e41026b-9a96-47df-a158-d8ea485025bd] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:04.676928 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writing DB stats nova_cell0:SELECT=8 {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:29:04.680477 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b5682409-258a-402f-be0b-abfa5c501b80 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:04.681138 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b5682409-258a-402f-be0b-abfa5c501b80 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:04.682009 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b5682409-258a-402f-be0b-abfa5c501b80 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:04.682635 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b5682409-258a-402f-be0b-abfa5c501b80 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:04.803898 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-50e59f06-8fce-492e-baea-1ee26fffd646 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:04.804484 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-50e59f06-8fce-492e-baea-1ee26fffd646 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] [instance: 90803094-e09d-4c65-9aba-88d612d0dafd] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:04.812093 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-50e59f06-8fce-492e-baea-1ee26fffd646 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:04.812556 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-50e59f06-8fce-492e-baea-1ee26fffd646 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:04.813437 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-50e59f06-8fce-492e-baea-1ee26fffd646 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:04.813956 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-50e59f06-8fce-492e-baea-1ee26fffd646 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:04.853229 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-b5682409-258a-402f-be0b-abfa5c501b80 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:04.861027 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-b5682409-258a-402f-be0b-abfa5c501b80 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd" status: 200 len: 1366 microversion: 2.1 time: 0.192421 Jun 07 09:29:04.864630 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 60/131] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:04 2022] GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd => generated 1366 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:04.874390 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-ba413d2d-6052-4efc-b790-4ab659e4f711 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:04.884256 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-ba413d2d-6052-4efc-b790-4ab659e4f711 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:04.884256 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-ba413d2d-6052-4efc-b790-4ab659e4f711 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:04.884256 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-ba413d2d-6052-4efc-b790-4ab659e4f711 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:04.885466 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-ba413d2d-6052-4efc-b790-4ab659e4f711 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:04.886608 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-ba413d2d-6052-4efc-b790-4ab659e4f711 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:04.963037 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-ba413d2d-6052-4efc-b790-4ab659e4f711 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:04.977734 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-ba413d2d-6052-4efc-b790-4ab659e4f711 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4" status: 200 len: 1281 microversion: 2.1 time: 0.107831 Jun 07 09:29:04.988447 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 61/132] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:04 2022] GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4 => generated 1281 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:05.000713 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-61dea2be-c9a8-4f6f-862e-94860cbd2095 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:05.000821 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-50e59f06-8fce-492e-baea-1ee26fffd646 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9726e11bda974054a1e972c097b1ea1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986f0a9e430e4caaaed4affc2d4b8aeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:05.000919 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-61dea2be-c9a8-4f6f-862e-94860cbd2095 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:05.007185 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-61dea2be-c9a8-4f6f-862e-94860cbd2095 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:05.007185 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-61dea2be-c9a8-4f6f-862e-94860cbd2095 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:05.007600 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-50e59f06-8fce-492e-baea-1ee26fffd646 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] 10.222.0.57 "GET /compute/v2.1/servers/90803094-e09d-4c65-9aba-88d612d0dafd" status: 200 len: 1314 microversion: 2.1 time: 0.210670 Jun 07 09:29:05.007702 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-61dea2be-c9a8-4f6f-862e-94860cbd2095 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:05.007702 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-61dea2be-c9a8-4f6f-862e-94860cbd2095 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:05.007933 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 72/133] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:04 2022] GET /compute/v2.1/servers/90803094-e09d-4c65-9aba-88d612d0dafd => generated 1314 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:29:05.077146 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-61dea2be-c9a8-4f6f-862e-94860cbd2095 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:05.086295 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-61dea2be-c9a8-4f6f-862e-94860cbd2095 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:05.087953 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-61dea2be-c9a8-4f6f-862e-94860cbd2095 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:05.089314 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-61dea2be-c9a8-4f6f-862e-94860cbd2095 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1340 microversion: 2.20 time: 0.105777 Jun 07 09:29:05.089863 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 62/134] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:29:04 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1340 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:29:05.188723 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [req-a17bb11a-69e8-4731-ad7d-6d4841747c79 req-c9d54f2c-4970-4d05-b5b4-a9f8366074b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90803094-e09d-4c65-9aba-88d612d0dafd", "name": "network-vif-plugged", "status": "completed", "tag": "919af0e4-f81f-4aea-8fcf-3f4ce64021c4"}]} {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:29:05.202114 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [req-a17bb11a-69e8-4731-ad7d-6d4841747c79 req-c9d54f2c-4970-4d05-b5b4-a9f8366074b9 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:05.202114 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [req-a17bb11a-69e8-4731-ad7d-6d4841747c79 req-c9d54f2c-4970-4d05-b5b4-a9f8366074b9 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:05.211317 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.compute.server_external_events [req-a17bb11a-69e8-4731-ad7d-6d4841747c79 req-c9d54f2c-4970-4d05-b5b4-a9f8366074b9 service nova] Creating event network-vif-plugged:919af0e4-f81f-4aea-8fcf-3f4ce64021c4 for instance 90803094-e09d-4c65-9aba-88d612d0dafd on hv-cinder-83699 Jun 07 09:29:05.217186 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [req-a17bb11a-69e8-4731-ad7d-6d4841747c79 req-c9d54f2c-4970-4d05-b5b4-a9f8366074b9 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097011 Jun 07 09:29:05.217902 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 73/135] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Jun 7 09:29:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 09:29:05.328624 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-d274cfea-888e-41d9-9a21-bf831d951206 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:05.328624 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-d274cfea-888e-41d9-9a21-bf831d951206 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:05.333955 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-d274cfea-888e-41d9-9a21-bf831d951206 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:05.334413 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-d274cfea-888e-41d9-9a21-bf831d951206 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:05.335197 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-d274cfea-888e-41d9-9a21-bf831d951206 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:05.335635 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-d274cfea-888e-41d9-9a21-bf831d951206 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:05.698388 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-d274cfea-888e-41d9-9a21-bf831d951206 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0346f4e3855142059983083e71c2c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c21b1cbbd604d6d9c97ab7c3c788f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:05.713693 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-d274cfea-888e-41d9-9a21-bf831d951206 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25" status: 200 len: 1362 microversion: 2.1 time: 0.392660 Jun 07 09:29:05.723010 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 63/136] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:05 2022] GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 => generated 1362 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:05.885699 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-56d0cf64-8a66-452d-bacd-9972d15294d3 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:05.885699 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-56d0cf64-8a66-452d-bacd-9972d15294d3 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 0e41026b-9a96-47df-a158-d8ea485025bd] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:05.892173 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-56d0cf64-8a66-452d-bacd-9972d15294d3 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:05.892651 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-56d0cf64-8a66-452d-bacd-9972d15294d3 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:05.893431 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-56d0cf64-8a66-452d-bacd-9972d15294d3 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:05.893871 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-56d0cf64-8a66-452d-bacd-9972d15294d3 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:05.996568 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-8ca15b24-caaf-47d2-a2d2-0562e2771dca tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:05.996568 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-8ca15b24-caaf-47d2-a2d2-0562e2771dca tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:06.015896 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-8ca15b24-caaf-47d2-a2d2-0562e2771dca tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:06.016639 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-8ca15b24-caaf-47d2-a2d2-0562e2771dca tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:06.017478 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-8ca15b24-caaf-47d2-a2d2-0562e2771dca tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:06.017968 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-8ca15b24-caaf-47d2-a2d2-0562e2771dca tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:06.114816 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-8ca15b24-caaf-47d2-a2d2-0562e2771dca tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:06.123953 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-8ca15b24-caaf-47d2-a2d2-0562e2771dca tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4" status: 200 len: 1279 microversion: 2.1 time: 0.132518 Jun 07 09:29:06.124834 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 64/137] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:05 2022] GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4 => generated 1279 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:06.129428 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-41a05c35-2bf6-4523-a705-bc804991240b tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:06.130201 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-41a05c35-2bf6-4523-a705-bc804991240b tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] [instance: 90803094-e09d-4c65-9aba-88d612d0dafd] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:06.136360 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-41a05c35-2bf6-4523-a705-bc804991240b tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:06.136845 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-41a05c35-2bf6-4523-a705-bc804991240b tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:06.137603 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-41a05c35-2bf6-4523-a705-bc804991240b tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:06.138136 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-41a05c35-2bf6-4523-a705-bc804991240b tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:06.203908 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-56d0cf64-8a66-452d-bacd-9972d15294d3 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:06.214378 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-56d0cf64-8a66-452d-bacd-9972d15294d3 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd" status: 200 len: 1366 microversion: 2.1 time: 0.336303 Jun 07 09:29:06.215124 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 74/138] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:05 2022] GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd => generated 1366 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:06.223420 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-ae3f828a-8312-4436-9228-bb06f50761c4 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:06.226635 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-ae3f828a-8312-4436-9228-bb06f50761c4 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:06.237152 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-ae3f828a-8312-4436-9228-bb06f50761c4 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:06.237152 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-ae3f828a-8312-4436-9228-bb06f50761c4 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:06.237564 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-ae3f828a-8312-4436-9228-bb06f50761c4 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:06.238082 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-ae3f828a-8312-4436-9228-bb06f50761c4 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:06.352155 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-ae3f828a-8312-4436-9228-bb06f50761c4 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:06.374101 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-ae3f828a-8312-4436-9228-bb06f50761c4 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:06.376908 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-ae3f828a-8312-4436-9228-bb06f50761c4 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:06.378357 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-ae3f828a-8312-4436-9228-bb06f50761c4 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1338 microversion: 2.20 time: 0.162206 Jun 07 09:29:06.390514 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 75/139] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:29:06 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1338 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:29:06.472865 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-41a05c35-2bf6-4523-a705-bc804991240b tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9726e11bda974054a1e972c097b1ea1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986f0a9e430e4caaaed4affc2d4b8aeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:06.485909 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-41a05c35-2bf6-4523-a705-bc804991240b tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] 10.222.0.57 "GET /compute/v2.1/servers/90803094-e09d-4c65-9aba-88d612d0dafd" status: 200 len: 1314 microversion: 2.1 time: 0.359847 Jun 07 09:29:06.486983 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 65/140] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:06 2022] GET /compute/v2.1/servers/90803094-e09d-4c65-9aba-88d612d0dafd => generated 1314 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:06.730745 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-f51ca3f0-7fab-47c5-9551-06869bc427fd tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:06.731554 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-f51ca3f0-7fab-47c5-9551-06869bc427fd tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:06.739052 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-f51ca3f0-7fab-47c5-9551-06869bc427fd tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:06.739861 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-f51ca3f0-7fab-47c5-9551-06869bc427fd tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:06.744262 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-f51ca3f0-7fab-47c5-9551-06869bc427fd tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:06.744262 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-f51ca3f0-7fab-47c5-9551-06869bc427fd tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:06.934207 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-f51ca3f0-7fab-47c5-9551-06869bc427fd tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0346f4e3855142059983083e71c2c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c21b1cbbd604d6d9c97ab7c3c788f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:06.938413 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [req-21b7514a-6f04-4443-9a70-97b6c8ce7cba req-2ddb2148-1c5f-4195-be7d-888abaf40729 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e41026b-9a96-47df-a158-d8ea485025bd", "tag": "0f719a33-a29f-4d0f-8c3c-af19fd8fe82d"}]} {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:29:06.947047 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [req-21b7514a-6f04-4443-9a70-97b6c8ce7cba req-2ddb2148-1c5f-4195-be7d-888abaf40729 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:06.947721 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [req-21b7514a-6f04-4443-9a70-97b6c8ce7cba req-2ddb2148-1c5f-4195-be7d-888abaf40729 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:06.950286 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-f51ca3f0-7fab-47c5-9551-06869bc427fd tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25" status: 200 len: 1362 microversion: 2.1 time: 0.223328 Jun 07 09:29:06.953982 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 76/141] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:06 2022] GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 => generated 1362 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:06.962125 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.compute.server_external_events [req-21b7514a-6f04-4443-9a70-97b6c8ce7cba req-2ddb2148-1c5f-4195-be7d-888abaf40729 service nova] Creating event network-changed:0f719a33-a29f-4d0f-8c3c-af19fd8fe82d for instance 0e41026b-9a96-47df-a158-d8ea485025bd on hv-cinder-83699 Jun 07 09:29:06.968814 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [req-21b7514a-6f04-4443-9a70-97b6c8ce7cba req-2ddb2148-1c5f-4195-be7d-888abaf40729 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039473 Jun 07 09:29:06.969579 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 66/142] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Jun 7 09:29:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 09:29:07.141977 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-1e0cc8bc-c585-4a48-9bbb-9a79e4a34ddf tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:07.142938 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-1e0cc8bc-c585-4a48-9bbb-9a79e4a34ddf tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:07.150187 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-1e0cc8bc-c585-4a48-9bbb-9a79e4a34ddf tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:07.151032 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-1e0cc8bc-c585-4a48-9bbb-9a79e4a34ddf tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:07.152186 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-1e0cc8bc-c585-4a48-9bbb-9a79e4a34ddf tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:07.152833 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-1e0cc8bc-c585-4a48-9bbb-9a79e4a34ddf tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:07.238220 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-4a127f8e-927d-4067-a737-5358cbc731af tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:07.239037 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-4a127f8e-927d-4067-a737-5358cbc731af tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 0e41026b-9a96-47df-a158-d8ea485025bd] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:07.258375 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-4a127f8e-927d-4067-a737-5358cbc731af tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:07.258924 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-4a127f8e-927d-4067-a737-5358cbc731af tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:07.259786 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-4a127f8e-927d-4067-a737-5358cbc731af tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:07.260381 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-4a127f8e-927d-4067-a737-5358cbc731af tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:07.347068 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-1e0cc8bc-c585-4a48-9bbb-9a79e4a34ddf tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:07.356916 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-1e0cc8bc-c585-4a48-9bbb-9a79e4a34ddf tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4" status: 200 len: 1321 microversion: 2.1 time: 0.219452 Jun 07 09:29:07.368519 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 77/143] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:07 2022] GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4 => generated 1321 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:07.397739 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-abc58746-e651-4210-98ac-5643392d9f21 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:07.398267 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-abc58746-e651-4210-98ac-5643392d9f21 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:07.406956 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-abc58746-e651-4210-98ac-5643392d9f21 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:07.407408 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-abc58746-e651-4210-98ac-5643392d9f21 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:07.408172 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-abc58746-e651-4210-98ac-5643392d9f21 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:07.408793 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-abc58746-e651-4210-98ac-5643392d9f21 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:07.451021 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-4a127f8e-927d-4067-a737-5358cbc731af tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:07.458485 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-4a127f8e-927d-4067-a737-5358cbc731af tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd" status: 200 len: 1366 microversion: 2.1 time: 0.230212 Jun 07 09:29:07.459061 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 67/144] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:07 2022] GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd => generated 1366 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:07.503392 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-b48920f0-625e-4806-a106-88a60c67fc4d tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:07.503934 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-b48920f0-625e-4806-a106-88a60c67fc4d tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] [instance: 90803094-e09d-4c65-9aba-88d612d0dafd] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:07.510623 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b48920f0-625e-4806-a106-88a60c67fc4d tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:07.512812 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b48920f0-625e-4806-a106-88a60c67fc4d tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:07.512812 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b48920f0-625e-4806-a106-88a60c67fc4d tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:07.512812 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b48920f0-625e-4806-a106-88a60c67fc4d tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:07.540722 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-abc58746-e651-4210-98ac-5643392d9f21 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:07.551319 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-abc58746-e651-4210-98ac-5643392d9f21 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:07.552886 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-abc58746-e651-4210-98ac-5643392d9f21 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:07.554037 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-abc58746-e651-4210-98ac-5643392d9f21 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1405 microversion: 2.20 time: 0.160281 Jun 07 09:29:07.558512 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 78/145] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:29:07 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1405 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:29:07.651493 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-b48920f0-625e-4806-a106-88a60c67fc4d tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9726e11bda974054a1e972c097b1ea1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986f0a9e430e4caaaed4affc2d4b8aeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:07.661875 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-b48920f0-625e-4806-a106-88a60c67fc4d tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] 10.222.0.57 "GET /compute/v2.1/servers/90803094-e09d-4c65-9aba-88d612d0dafd" status: 200 len: 1314 microversion: 2.1 time: 0.162180 Jun 07 09:29:07.662757 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 68/146] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:07 2022] GET /compute/v2.1/servers/90803094-e09d-4c65-9aba-88d612d0dafd => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:29:07.967167 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-5ac47005-89f6-40fe-b1ea-6eb4eb42b906 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:07.967777 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-5ac47005-89f6-40fe-b1ea-6eb4eb42b906 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:07.973784 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-5ac47005-89f6-40fe-b1ea-6eb4eb42b906 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:07.974232 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-5ac47005-89f6-40fe-b1ea-6eb4eb42b906 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:07.974984 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-5ac47005-89f6-40fe-b1ea-6eb4eb42b906 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:07.975420 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-5ac47005-89f6-40fe-b1ea-6eb4eb42b906 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:08.183701 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-5ac47005-89f6-40fe-b1ea-6eb4eb42b906 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0346f4e3855142059983083e71c2c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c21b1cbbd604d6d9c97ab7c3c788f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:08.192279 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-5ac47005-89f6-40fe-b1ea-6eb4eb42b906 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25" status: 200 len: 1362 microversion: 2.1 time: 0.228838 Jun 07 09:29:08.193015 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 79/147] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:07 2022] GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 => generated 1362 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:08.374232 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-2dd60ff7-b6a3-4c19-9521-515cdabe6268 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:08.374851 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-2dd60ff7-b6a3-4c19-9521-515cdabe6268 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:08.381032 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-2dd60ff7-b6a3-4c19-9521-515cdabe6268 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:08.381584 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-2dd60ff7-b6a3-4c19-9521-515cdabe6268 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:08.382360 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-2dd60ff7-b6a3-4c19-9521-515cdabe6268 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:08.382806 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-2dd60ff7-b6a3-4c19-9521-515cdabe6268 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:08.385557 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writing DB stats nova_cell1:SELECT=100 {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:29:08.475122 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-76dd3627-129f-4f93-9eda-254ff589646e tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:08.475973 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-76dd3627-129f-4f93-9eda-254ff589646e tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 0e41026b-9a96-47df-a158-d8ea485025bd] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:08.483315 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-76dd3627-129f-4f93-9eda-254ff589646e tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:08.484022 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-76dd3627-129f-4f93-9eda-254ff589646e tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:08.484817 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-76dd3627-129f-4f93-9eda-254ff589646e tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:08.485435 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-76dd3627-129f-4f93-9eda-254ff589646e tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:08.502779 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writing DB stats nova_cell1:SELECT=100 {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:29:08.519574 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-2dd60ff7-b6a3-4c19-9521-515cdabe6268 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:08.527046 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-2dd60ff7-b6a3-4c19-9521-515cdabe6268 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4" status: 200 len: 1321 microversion: 2.1 time: 0.157372 Jun 07 09:29:08.527619 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 69/148] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:08 2022] GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4 => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:08.572556 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-400725be-5ee2-4a1e-bcc1-be5272ca4ddc tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:08.578546 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-400725be-5ee2-4a1e-bcc1-be5272ca4ddc tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:08.604187 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-400725be-5ee2-4a1e-bcc1-be5272ca4ddc tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:08.605920 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-400725be-5ee2-4a1e-bcc1-be5272ca4ddc tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:08.607406 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-400725be-5ee2-4a1e-bcc1-be5272ca4ddc tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:08.610371 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-400725be-5ee2-4a1e-bcc1-be5272ca4ddc tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:08.775304 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-76dd3627-129f-4f93-9eda-254ff589646e tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:08.807149 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-76dd3627-129f-4f93-9eda-254ff589646e tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd" status: 200 len: 1366 microversion: 2.1 time: 0.335669 Jun 07 09:29:08.810770 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 80/149] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:08 2022] GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd => generated 1366 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:29:08.833888 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-9ec550ef-69fb-4c26-8a2c-a6470aef21da tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:08.835969 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-9ec550ef-69fb-4c26-8a2c-a6470aef21da tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] [instance: 90803094-e09d-4c65-9aba-88d612d0dafd] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:08.854922 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:29:08.857335 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-9ec550ef-69fb-4c26-8a2c-a6470aef21da tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:08.860574 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-9ec550ef-69fb-4c26-8a2c-a6470aef21da tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:08.863794 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-9ec550ef-69fb-4c26-8a2c-a6470aef21da tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:08.865115 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-9ec550ef-69fb-4c26-8a2c-a6470aef21da tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:08.897229 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-400725be-5ee2-4a1e-bcc1-be5272ca4ddc tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:08.909330 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-400725be-5ee2-4a1e-bcc1-be5272ca4ddc tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:08.913275 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-400725be-5ee2-4a1e-bcc1-be5272ca4ddc tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:08.916594 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-400725be-5ee2-4a1e-bcc1-be5272ca4ddc tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1405 microversion: 2.20 time: 0.347944 Jun 07 09:29:08.917481 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 70/150] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:29:08 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1405 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:29:09.211134 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-68cc3d3e-34d5-4e60-84d6-991d0d7580f1 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:09.212056 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-68cc3d3e-34d5-4e60-84d6-991d0d7580f1 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:09.219904 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-68cc3d3e-34d5-4e60-84d6-991d0d7580f1 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:09.220350 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-68cc3d3e-34d5-4e60-84d6-991d0d7580f1 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:09.221154 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-68cc3d3e-34d5-4e60-84d6-991d0d7580f1 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:09.221611 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-68cc3d3e-34d5-4e60-84d6-991d0d7580f1 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:09.242906 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-9ec550ef-69fb-4c26-8a2c-a6470aef21da tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9726e11bda974054a1e972c097b1ea1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986f0a9e430e4caaaed4affc2d4b8aeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:09.255656 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-9ec550ef-69fb-4c26-8a2c-a6470aef21da tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] 10.222.0.57 "GET /compute/v2.1/servers/90803094-e09d-4c65-9aba-88d612d0dafd" status: 200 len: 1314 microversion: 2.1 time: 0.429167 Jun 07 09:29:09.256345 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 81/151] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:08 2022] GET /compute/v2.1/servers/90803094-e09d-4c65-9aba-88d612d0dafd => generated 1314 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:09.265704 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [req-f25f9abf-5281-4b26-af57-0ae4ec8651f5 req-db54ae72-8a6c-4306-a021-bee4a41ddb28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77d18a34-ad63-453f-9b17-517bd85a6f42", "name": "network-vif-plugged", "status": "completed", "tag": "34b7939d-c0b3-49e3-ae23-f8bdfdcbb074"}]} {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:29:09.276084 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [req-f25f9abf-5281-4b26-af57-0ae4ec8651f5 req-db54ae72-8a6c-4306-a021-bee4a41ddb28 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:09.277338 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [req-f25f9abf-5281-4b26-af57-0ae4ec8651f5 req-db54ae72-8a6c-4306-a021-bee4a41ddb28 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:09.310039 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.compute.server_external_events [req-f25f9abf-5281-4b26-af57-0ae4ec8651f5 req-db54ae72-8a6c-4306-a021-bee4a41ddb28 service nova] Creating event network-vif-plugged:34b7939d-c0b3-49e3-ae23-f8bdfdcbb074 for instance 77d18a34-ad63-453f-9b17-517bd85a6f42 on hv-cinder-83699 Jun 07 09:29:09.310039 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [req-f25f9abf-5281-4b26-af57-0ae4ec8651f5 req-db54ae72-8a6c-4306-a021-bee4a41ddb28 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047528 Jun 07 09:29:09.310039 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 82/152] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Jun 7 09:29:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:29:09.543569 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-19b91e7f-7cd4-423c-a9e7-c26c272ac096 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:09.553223 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-19b91e7f-7cd4-423c-a9e7-c26c272ac096 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:09.553223 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-19b91e7f-7cd4-423c-a9e7-c26c272ac096 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:09.553223 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-19b91e7f-7cd4-423c-a9e7-c26c272ac096 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:09.553859 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-19b91e7f-7cd4-423c-a9e7-c26c272ac096 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:09.554313 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-19b91e7f-7cd4-423c-a9e7-c26c272ac096 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:09.687678 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-68cc3d3e-34d5-4e60-84d6-991d0d7580f1 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0346f4e3855142059983083e71c2c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c21b1cbbd604d6d9c97ab7c3c788f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:09.700044 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-68cc3d3e-34d5-4e60-84d6-991d0d7580f1 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25" status: 200 len: 1362 microversion: 2.1 time: 0.492871 Jun 07 09:29:09.702707 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 71/153] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:09 2022] GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 => generated 1362 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:09.827230 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-a3dea00a-11aa-4feb-8410-b05f545b2d81 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:09.827789 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-a3dea00a-11aa-4feb-8410-b05f545b2d81 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 0e41026b-9a96-47df-a158-d8ea485025bd] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:09.834372 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-a3dea00a-11aa-4feb-8410-b05f545b2d81 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:09.835007 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-a3dea00a-11aa-4feb-8410-b05f545b2d81 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:09.836091 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-a3dea00a-11aa-4feb-8410-b05f545b2d81 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:09.836556 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-a3dea00a-11aa-4feb-8410-b05f545b2d81 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:09.996088 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-a3dea00a-11aa-4feb-8410-b05f545b2d81 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:10.010508 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-a3dea00a-11aa-4feb-8410-b05f545b2d81 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd" status: 200 len: 1366 microversion: 2.1 time: 0.186850 Jun 07 09:29:10.013899 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-19b91e7f-7cd4-423c-a9e7-c26c272ac096 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:10.022288 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-19b91e7f-7cd4-423c-a9e7-c26c272ac096 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4" status: 200 len: 1321 microversion: 2.1 time: 0.482626 Jun 07 09:29:10.023655 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 83/154] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:09 2022] GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4 => generated 1321 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:29:10.028337 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 72/155] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:09 2022] GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd => generated 1366 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:10.030536 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-67e2fb83-6c77-4d0c-aba4-7b2ae4ec2f67 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:10.031312 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-67e2fb83-6c77-4d0c-aba4-7b2ae4ec2f67 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:10.038852 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-67e2fb83-6c77-4d0c-aba4-7b2ae4ec2f67 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:10.039311 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-67e2fb83-6c77-4d0c-aba4-7b2ae4ec2f67 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:10.040092 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-67e2fb83-6c77-4d0c-aba4-7b2ae4ec2f67 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:10.040528 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-67e2fb83-6c77-4d0c-aba4-7b2ae4ec2f67 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:10.138425 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [req-b5463ba4-1858-458e-a4a9-52d8f8bf94da req-b4eb139b-37dc-4c44-a5ae-30b2bed47689 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "102039c7-8224-43f7-9fb8-90b82968cfa2", "tag": "647bfcc4-5bf0-429c-803e-b72ea4c0fa25"}]} {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:29:10.155147 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [req-b5463ba4-1858-458e-a4a9-52d8f8bf94da req-b4eb139b-37dc-4c44-a5ae-30b2bed47689 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:10.155861 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [req-b5463ba4-1858-458e-a4a9-52d8f8bf94da req-b4eb139b-37dc-4c44-a5ae-30b2bed47689 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:10.175573 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.compute.server_external_events [req-b5463ba4-1858-458e-a4a9-52d8f8bf94da req-b4eb139b-37dc-4c44-a5ae-30b2bed47689 service nova] Creating event network-changed:647bfcc4-5bf0-429c-803e-b72ea4c0fa25 for instance 102039c7-8224-43f7-9fb8-90b82968cfa2 on hv-cinder-83699 Jun 07 09:29:10.178511 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [req-b5463ba4-1858-458e-a4a9-52d8f8bf94da req-b4eb139b-37dc-4c44-a5ae-30b2bed47689 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049623 Jun 07 09:29:10.180795 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 73/156] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Jun 7 09:29:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 09:29:10.219661 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-67e2fb83-6c77-4d0c-aba4-7b2ae4ec2f67 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:10.228382 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-67e2fb83-6c77-4d0c-aba4-7b2ae4ec2f67 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:10.230009 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-67e2fb83-6c77-4d0c-aba4-7b2ae4ec2f67 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:10.231250 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-67e2fb83-6c77-4d0c-aba4-7b2ae4ec2f67 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1405 microversion: 2.20 time: 0.205953 Jun 07 09:29:10.231915 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 84/157] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:29:10 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1405 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:29:10.273808 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-02ef1224-02cb-45be-9f18-bc298a0c0ecf tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:10.274546 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-02ef1224-02cb-45be-9f18-bc298a0c0ecf tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] [instance: 90803094-e09d-4c65-9aba-88d612d0dafd] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:10.281322 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-02ef1224-02cb-45be-9f18-bc298a0c0ecf tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:10.281807 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-02ef1224-02cb-45be-9f18-bc298a0c0ecf tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:10.282612 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-02ef1224-02cb-45be-9f18-bc298a0c0ecf tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:10.283079 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-02ef1224-02cb-45be-9f18-bc298a0c0ecf tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:10.440496 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [req-3975822d-f5cc-4021-a7cb-ec9c611de92c req-abbb1fcc-58b6-4fba-9a38-6493ba2464cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4", "tag": "ef58ec65-d688-494a-a9db-c6f18cac46a0"}]} {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:29:10.449199 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-02ef1224-02cb-45be-9f18-bc298a0c0ecf tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9726e11bda974054a1e972c097b1ea1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986f0a9e430e4caaaed4affc2d4b8aeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:10.454949 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-02ef1224-02cb-45be-9f18-bc298a0c0ecf tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] 10.222.0.57 "GET /compute/v2.1/servers/90803094-e09d-4c65-9aba-88d612d0dafd" status: 200 len: 1314 microversion: 2.1 time: 0.185513 Jun 07 09:29:10.456520 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [req-3975822d-f5cc-4021-a7cb-ec9c611de92c req-abbb1fcc-58b6-4fba-9a38-6493ba2464cc service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:10.457145 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [req-3975822d-f5cc-4021-a7cb-ec9c611de92c req-abbb1fcc-58b6-4fba-9a38-6493ba2464cc service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:10.458841 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 74/158] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:10 2022] GET /compute/v2.1/servers/90803094-e09d-4c65-9aba-88d612d0dafd => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:10.469408 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.compute.server_external_events [req-3975822d-f5cc-4021-a7cb-ec9c611de92c req-abbb1fcc-58b6-4fba-9a38-6493ba2464cc service nova] Creating event network-changed:ef58ec65-d688-494a-a9db-c6f18cac46a0 for instance a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4 on hv-cinder-83699 Jun 07 09:29:10.474730 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [req-3975822d-f5cc-4021-a7cb-ec9c611de92c req-abbb1fcc-58b6-4fba-9a38-6493ba2464cc service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037875 Jun 07 09:29:10.476873 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 85/159] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Jun 7 09:29:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 09:29:10.719380 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-82718e0f-c021-41c5-aa7f-5c3372823f98 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:10.719899 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-82718e0f-c021-41c5-aa7f-5c3372823f98 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:10.721884 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:29:10.726866 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-82718e0f-c021-41c5-aa7f-5c3372823f98 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:10.727314 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-82718e0f-c021-41c5-aa7f-5c3372823f98 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:10.728077 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-82718e0f-c021-41c5-aa7f-5c3372823f98 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:10.728513 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-82718e0f-c021-41c5-aa7f-5c3372823f98 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:10.852406 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-82718e0f-c021-41c5-aa7f-5c3372823f98 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0346f4e3855142059983083e71c2c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c21b1cbbd604d6d9c97ab7c3c788f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:10.860478 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-82718e0f-c021-41c5-aa7f-5c3372823f98 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25" status: 200 len: 1362 microversion: 2.1 time: 0.145169 Jun 07 09:29:10.861074 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 75/160] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:10 2022] GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 => generated 1362 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:11.028085 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-e0a747ff-3d7f-4ee6-b058-c2a8ba20a584 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:11.029458 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-e0a747ff-3d7f-4ee6-b058-c2a8ba20a584 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 0e41026b-9a96-47df-a158-d8ea485025bd] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:11.036533 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-e0a747ff-3d7f-4ee6-b058-c2a8ba20a584 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:11.037019 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-e0a747ff-3d7f-4ee6-b058-c2a8ba20a584 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:11.037805 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-e0a747ff-3d7f-4ee6-b058-c2a8ba20a584 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:11.038239 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-e0a747ff-3d7f-4ee6-b058-c2a8ba20a584 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:11.039986 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-831de4a7-7010-477f-a83e-6fd9a6ae047a tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:11.041032 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-831de4a7-7010-477f-a83e-6fd9a6ae047a tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:11.048486 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-831de4a7-7010-477f-a83e-6fd9a6ae047a tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:11.049067 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-831de4a7-7010-477f-a83e-6fd9a6ae047a tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:11.049927 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-831de4a7-7010-477f-a83e-6fd9a6ae047a tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:11.050694 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-831de4a7-7010-477f-a83e-6fd9a6ae047a tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:11.180754 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-e0a747ff-3d7f-4ee6-b058-c2a8ba20a584 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:11.188740 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-831de4a7-7010-477f-a83e-6fd9a6ae047a tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:11.188890 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-e0a747ff-3d7f-4ee6-b058-c2a8ba20a584 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd" status: 200 len: 1366 microversion: 2.1 time: 0.165027 Jun 07 09:29:11.189406 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 86/161] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:11 2022] GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:11.199316 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-831de4a7-7010-477f-a83e-6fd9a6ae047a tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4" status: 200 len: 1321 microversion: 2.1 time: 0.161822 Jun 07 09:29:11.199316 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 76/162] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:11 2022] GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4 => generated 1321 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:29:11.250344 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-6a7faeb9-836d-45e0-acda-5d84da1825ff tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:11.250879 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-6a7faeb9-836d-45e0-acda-5d84da1825ff tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:11.256768 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-6a7faeb9-836d-45e0-acda-5d84da1825ff tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:11.257213 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-6a7faeb9-836d-45e0-acda-5d84da1825ff tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:11.257967 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-6a7faeb9-836d-45e0-acda-5d84da1825ff tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:11.258398 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-6a7faeb9-836d-45e0-acda-5d84da1825ff tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:11.389184 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-6a7faeb9-836d-45e0-acda-5d84da1825ff tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:11.396980 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-6a7faeb9-836d-45e0-acda-5d84da1825ff tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:11.398462 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-6a7faeb9-836d-45e0-acda-5d84da1825ff tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:11.399558 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-6a7faeb9-836d-45e0-acda-5d84da1825ff tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1405 microversion: 2.20 time: 0.153187 Jun 07 09:29:11.400110 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 87/163] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:29:11 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1405 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:29:11.476750 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-dc543c78-495d-43ee-831f-310742c7a715 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:11.477374 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-dc543c78-495d-43ee-831f-310742c7a715 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] [instance: 90803094-e09d-4c65-9aba-88d612d0dafd] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:11.483955 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-dc543c78-495d-43ee-831f-310742c7a715 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:11.484404 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-dc543c78-495d-43ee-831f-310742c7a715 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:11.485223 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-dc543c78-495d-43ee-831f-310742c7a715 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:11.485658 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-dc543c78-495d-43ee-831f-310742c7a715 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:11.614324 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-dc543c78-495d-43ee-831f-310742c7a715 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9726e11bda974054a1e972c097b1ea1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986f0a9e430e4caaaed4affc2d4b8aeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:11.621639 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-dc543c78-495d-43ee-831f-310742c7a715 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] 10.222.0.57 "GET /compute/v2.1/servers/90803094-e09d-4c65-9aba-88d612d0dafd" status: 200 len: 1314 microversion: 2.1 time: 0.148803 Jun 07 09:29:11.622240 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 77/164] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:11 2022] GET /compute/v2.1/servers/90803094-e09d-4c65-9aba-88d612d0dafd => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:11.877449 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-adbb1c2a-ee24-4966-8ae4-94047bf6bb6f tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:11.877976 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-adbb1c2a-ee24-4966-8ae4-94047bf6bb6f tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:11.883849 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-adbb1c2a-ee24-4966-8ae4-94047bf6bb6f tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:11.884305 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-adbb1c2a-ee24-4966-8ae4-94047bf6bb6f tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:11.885109 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-adbb1c2a-ee24-4966-8ae4-94047bf6bb6f tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:11.885541 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-adbb1c2a-ee24-4966-8ae4-94047bf6bb6f tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:12.013552 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-adbb1c2a-ee24-4966-8ae4-94047bf6bb6f tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0346f4e3855142059983083e71c2c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c21b1cbbd604d6d9c97ab7c3c788f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:12.020976 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-adbb1c2a-ee24-4966-8ae4-94047bf6bb6f tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25" status: 200 len: 1362 microversion: 2.1 time: 0.147430 Jun 07 09:29:12.021535 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 88/165] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:11 2022] GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:29:12.205987 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-99f6570a-3673-4c1d-a781-dde683a81f42 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:12.206630 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-99f6570a-3673-4c1d-a781-dde683a81f42 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 0e41026b-9a96-47df-a158-d8ea485025bd] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:12.212840 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-99f6570a-3673-4c1d-a781-dde683a81f42 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:12.213288 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-99f6570a-3673-4c1d-a781-dde683a81f42 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:12.214701 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-99f6570a-3673-4c1d-a781-dde683a81f42 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:12.214905 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-b01eac3c-5ed1-446d-a13d-370b816df842 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:12.214996 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-99f6570a-3673-4c1d-a781-dde683a81f42 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:12.215081 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-b01eac3c-5ed1-446d-a13d-370b816df842 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:12.223491 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b01eac3c-5ed1-446d-a13d-370b816df842 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:12.223941 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b01eac3c-5ed1-446d-a13d-370b816df842 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:12.224750 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b01eac3c-5ed1-446d-a13d-370b816df842 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:12.225173 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b01eac3c-5ed1-446d-a13d-370b816df842 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:12.342799 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-99f6570a-3673-4c1d-a781-dde683a81f42 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:12.350342 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-99f6570a-3673-4c1d-a781-dde683a81f42 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd" status: 200 len: 1366 microversion: 2.1 time: 0.148218 Jun 07 09:29:12.350907 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 78/166] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:12 2022] GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:12.360183 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-b01eac3c-5ed1-446d-a13d-370b816df842 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:12.367453 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-b01eac3c-5ed1-446d-a13d-370b816df842 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4" status: 200 len: 1321 microversion: 2.1 time: 0.156852 Jun 07 09:29:12.368025 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 89/167] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:12 2022] GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4 => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:29:12.418082 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-8cfb0887-4878-4963-8877-684de37b6e53 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:12.418681 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-8cfb0887-4878-4963-8877-684de37b6e53 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:12.424770 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-8cfb0887-4878-4963-8877-684de37b6e53 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:12.425217 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-8cfb0887-4878-4963-8877-684de37b6e53 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:12.426008 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-8cfb0887-4878-4963-8877-684de37b6e53 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:12.426435 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-8cfb0887-4878-4963-8877-684de37b6e53 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:12.562743 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-8cfb0887-4878-4963-8877-684de37b6e53 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:12.570167 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-8cfb0887-4878-4963-8877-684de37b6e53 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:12.571684 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-8cfb0887-4878-4963-8877-684de37b6e53 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:12.572829 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-8cfb0887-4878-4963-8877-684de37b6e53 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1405 microversion: 2.20 time: 0.158607 Jun 07 09:29:12.573578 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 79/168] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:29:12 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1405 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:29:12.639040 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-4075fbd0-2600-4224-b98f-d3e280f1afd5 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:12.639650 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-4075fbd0-2600-4224-b98f-d3e280f1afd5 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] [instance: 90803094-e09d-4c65-9aba-88d612d0dafd] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:12.646070 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-4075fbd0-2600-4224-b98f-d3e280f1afd5 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:12.647165 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-4075fbd0-2600-4224-b98f-d3e280f1afd5 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:12.648005 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-4075fbd0-2600-4224-b98f-d3e280f1afd5 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:12.648507 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-4075fbd0-2600-4224-b98f-d3e280f1afd5 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:12.776642 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-4075fbd0-2600-4224-b98f-d3e280f1afd5 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9726e11bda974054a1e972c097b1ea1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986f0a9e430e4caaaed4affc2d4b8aeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:12.784187 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-4075fbd0-2600-4224-b98f-d3e280f1afd5 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] 10.222.0.57 "GET /compute/v2.1/servers/90803094-e09d-4c65-9aba-88d612d0dafd" status: 200 len: 1314 microversion: 2.1 time: 0.149696 Jun 07 09:29:12.784783 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 90/169] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:12 2022] GET /compute/v2.1/servers/90803094-e09d-4c65-9aba-88d612d0dafd => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:13.037540 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-a1c61eb3-476a-468f-9648-4d1923c3829c tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:13.038151 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-a1c61eb3-476a-468f-9648-4d1923c3829c tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:13.045539 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-a1c61eb3-476a-468f-9648-4d1923c3829c tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:13.046052 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-a1c61eb3-476a-468f-9648-4d1923c3829c tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:13.046872 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-a1c61eb3-476a-468f-9648-4d1923c3829c tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:13.047309 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-a1c61eb3-476a-468f-9648-4d1923c3829c tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:13.179549 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-a1c61eb3-476a-468f-9648-4d1923c3829c tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0346f4e3855142059983083e71c2c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c21b1cbbd604d6d9c97ab7c3c788f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:13.188000 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-a1c61eb3-476a-468f-9648-4d1923c3829c tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25" status: 200 len: 1362 microversion: 2.1 time: 0.154391 Jun 07 09:29:13.188602 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 80/170] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:13 2022] GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:13.367244 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-452aeed0-7c40-4b53-b7d7-bc7bb285a12f tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:13.367854 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-452aeed0-7c40-4b53-b7d7-bc7bb285a12f tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 0e41026b-9a96-47df-a158-d8ea485025bd] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:13.374863 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-452aeed0-7c40-4b53-b7d7-bc7bb285a12f tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:13.375308 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-452aeed0-7c40-4b53-b7d7-bc7bb285a12f tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:13.376104 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-452aeed0-7c40-4b53-b7d7-bc7bb285a12f tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:13.376534 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-452aeed0-7c40-4b53-b7d7-bc7bb285a12f tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:13.383315 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-5f0ea9dc-1623-4b40-8661-bd46700f8af0 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:13.384148 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-5f0ea9dc-1623-4b40-8661-bd46700f8af0 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:13.390317 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-5f0ea9dc-1623-4b40-8661-bd46700f8af0 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:13.394010 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-5f0ea9dc-1623-4b40-8661-bd46700f8af0 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:13.394010 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-5f0ea9dc-1623-4b40-8661-bd46700f8af0 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:13.394010 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-5f0ea9dc-1623-4b40-8661-bd46700f8af0 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:13.520360 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-5f0ea9dc-1623-4b40-8661-bd46700f8af0 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:13.527795 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-5f0ea9dc-1623-4b40-8661-bd46700f8af0 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4" status: 200 len: 1321 microversion: 2.1 time: 0.148492 Jun 07 09:29:13.528883 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 81/171] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:13 2022] GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4 => generated 1321 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:29:13.532887 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-452aeed0-7c40-4b53-b7d7-bc7bb285a12f tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:13.541492 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-452aeed0-7c40-4b53-b7d7-bc7bb285a12f tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd" status: 200 len: 1366 microversion: 2.1 time: 0.178151 Jun 07 09:29:13.542046 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 91/172] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:13 2022] GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:13.591839 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-69b8fd8d-787a-4b91-a8d1-541f0f80981d tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:13.592566 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-69b8fd8d-787a-4b91-a8d1-541f0f80981d tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:13.598855 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-69b8fd8d-787a-4b91-a8d1-541f0f80981d tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:13.599308 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-69b8fd8d-787a-4b91-a8d1-541f0f80981d tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:13.600063 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-69b8fd8d-787a-4b91-a8d1-541f0f80981d tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:13.600493 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-69b8fd8d-787a-4b91-a8d1-541f0f80981d tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:13.779760 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-69b8fd8d-787a-4b91-a8d1-541f0f80981d tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:13.787903 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-69b8fd8d-787a-4b91-a8d1-541f0f80981d tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:13.789491 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-69b8fd8d-787a-4b91-a8d1-541f0f80981d tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:13.790580 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-69b8fd8d-787a-4b91-a8d1-541f0f80981d tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1405 microversion: 2.20 time: 0.203262 Jun 07 09:29:13.791183 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 82/173] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:29:13 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1405 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:29:13.801123 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-a4210541-6d55-4188-8b34-8ca36e0a21b4 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:13.801842 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-a4210541-6d55-4188-8b34-8ca36e0a21b4 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] [instance: 90803094-e09d-4c65-9aba-88d612d0dafd] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:13.807876 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-a4210541-6d55-4188-8b34-8ca36e0a21b4 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:13.808328 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-a4210541-6d55-4188-8b34-8ca36e0a21b4 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:13.809155 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-a4210541-6d55-4188-8b34-8ca36e0a21b4 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:13.809597 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-a4210541-6d55-4188-8b34-8ca36e0a21b4 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:13.939056 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-a4210541-6d55-4188-8b34-8ca36e0a21b4 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9726e11bda974054a1e972c097b1ea1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986f0a9e430e4caaaed4affc2d4b8aeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:13.946552 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-a4210541-6d55-4188-8b34-8ca36e0a21b4 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] 10.222.0.57 "GET /compute/v2.1/servers/90803094-e09d-4c65-9aba-88d612d0dafd" status: 200 len: 1314 microversion: 2.1 time: 0.149244 Jun 07 09:29:13.947055 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 92/174] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:13 2022] GET /compute/v2.1/servers/90803094-e09d-4c65-9aba-88d612d0dafd => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:14.205597 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-559dc67f-7174-4b37-aae3-41572466f161 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:14.206143 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-559dc67f-7174-4b37-aae3-41572466f161 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:14.212257 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-559dc67f-7174-4b37-aae3-41572466f161 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:14.212740 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-559dc67f-7174-4b37-aae3-41572466f161 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:14.213530 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-559dc67f-7174-4b37-aae3-41572466f161 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:14.213965 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-559dc67f-7174-4b37-aae3-41572466f161 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:14.346982 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-559dc67f-7174-4b37-aae3-41572466f161 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0346f4e3855142059983083e71c2c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c21b1cbbd604d6d9c97ab7c3c788f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:14.355621 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-559dc67f-7174-4b37-aae3-41572466f161 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25" status: 200 len: 1362 microversion: 2.1 time: 0.153978 Jun 07 09:29:14.356191 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 83/175] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:14 2022] GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:14.546172 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-771d0361-e3b6-4d7d-8aee-82b97aac6a60 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:14.546786 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-771d0361-e3b6-4d7d-8aee-82b97aac6a60 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:14.555769 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-771d0361-e3b6-4d7d-8aee-82b97aac6a60 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:14.556500 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-771d0361-e3b6-4d7d-8aee-82b97aac6a60 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:14.557460 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-771d0361-e3b6-4d7d-8aee-82b97aac6a60 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:14.558083 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-771d0361-e3b6-4d7d-8aee-82b97aac6a60 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:14.559088 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-5896c9ce-6ddb-4bed-90b7-40110e5be9a5 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:14.559812 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-5896c9ce-6ddb-4bed-90b7-40110e5be9a5 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 0e41026b-9a96-47df-a158-d8ea485025bd] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:14.571058 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-5896c9ce-6ddb-4bed-90b7-40110e5be9a5 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:14.571501 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-5896c9ce-6ddb-4bed-90b7-40110e5be9a5 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:14.572324 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-5896c9ce-6ddb-4bed-90b7-40110e5be9a5 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:14.572784 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-5896c9ce-6ddb-4bed-90b7-40110e5be9a5 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:14.745686 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-771d0361-e3b6-4d7d-8aee-82b97aac6a60 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:14.756649 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-771d0361-e3b6-4d7d-8aee-82b97aac6a60 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4" status: 200 len: 1321 microversion: 2.1 time: 0.215044 Jun 07 09:29:14.756853 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-5896c9ce-6ddb-4bed-90b7-40110e5be9a5 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:14.757565 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 93/176] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:14 2022] GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4 => generated 1321 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:14.767451 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-5896c9ce-6ddb-4bed-90b7-40110e5be9a5 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd" status: 200 len: 1366 microversion: 2.1 time: 0.212187 Jun 07 09:29:14.768030 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 84/177] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:14 2022] GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd => generated 1366 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:14.808194 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-c025a6b8-5743-4019-82e1-ef085523bc8c tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:14.808836 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-c025a6b8-5743-4019-82e1-ef085523bc8c tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:14.815181 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-c025a6b8-5743-4019-82e1-ef085523bc8c tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:14.815684 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-c025a6b8-5743-4019-82e1-ef085523bc8c tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:14.816461 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-c025a6b8-5743-4019-82e1-ef085523bc8c tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:14.816947 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-c025a6b8-5743-4019-82e1-ef085523bc8c tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:14.959888 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-c025a6b8-5743-4019-82e1-ef085523bc8c tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:14.963039 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-8fb86d80-908d-41c8-b682-bc0e48d5681a tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:14.963637 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-8fb86d80-908d-41c8-b682-bc0e48d5681a tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] [instance: 90803094-e09d-4c65-9aba-88d612d0dafd] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:14.969405 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-c025a6b8-5743-4019-82e1-ef085523bc8c tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:14.970934 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-8fb86d80-908d-41c8-b682-bc0e48d5681a tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:14.971178 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-c025a6b8-5743-4019-82e1-ef085523bc8c tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:14.971604 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-8fb86d80-908d-41c8-b682-bc0e48d5681a tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:14.972424 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-8fb86d80-908d-41c8-b682-bc0e48d5681a tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:14.972533 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-c025a6b8-5743-4019-82e1-ef085523bc8c tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1405 microversion: 2.20 time: 0.168072 Jun 07 09:29:14.972884 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-8fb86d80-908d-41c8-b682-bc0e48d5681a tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:14.973208 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 94/178] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:29:14 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1405 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 09:29:15.270137 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-8fb86d80-908d-41c8-b682-bc0e48d5681a tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9726e11bda974054a1e972c097b1ea1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986f0a9e430e4caaaed4affc2d4b8aeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:15.279463 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-8fb86d80-908d-41c8-b682-bc0e48d5681a tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] 10.222.0.57 "GET /compute/v2.1/servers/90803094-e09d-4c65-9aba-88d612d0dafd" status: 200 len: 1501 microversion: 2.1 time: 0.320156 Jun 07 09:29:15.280608 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 85/179] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:14 2022] GET /compute/v2.1/servers/90803094-e09d-4c65-9aba-88d612d0dafd => generated 1501 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:29:15.371740 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [req-843e63ad-a594-4911-b7a1-09c6ae720137 req-164ab87c-18a5-4c65-b3b4-afcd87b5f74f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25", "name": "network-vif-plugged", "status": "completed", "tag": "0d872428-4ab3-4d4f-845c-f8715f978155"}]} {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:29:15.379950 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-4a1a5dbe-c46b-4ccf-9bfb-cf36384b6608 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:15.380561 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-4a1a5dbe-c46b-4ccf-9bfb-cf36384b6608 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:15.381534 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [req-843e63ad-a594-4911-b7a1-09c6ae720137 req-164ab87c-18a5-4c65-b3b4-afcd87b5f74f service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:15.382079 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [req-843e63ad-a594-4911-b7a1-09c6ae720137 req-164ab87c-18a5-4c65-b3b4-afcd87b5f74f service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:15.395160 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.compute.server_external_events [req-843e63ad-a594-4911-b7a1-09c6ae720137 req-164ab87c-18a5-4c65-b3b4-afcd87b5f74f service nova] Creating event network-vif-plugged:0d872428-4ab3-4d4f-845c-f8715f978155 for instance 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 on hv-cinder-83699 Jun 07 09:29:15.400273 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-4a1a5dbe-c46b-4ccf-9bfb-cf36384b6608 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:15.400449 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [req-843e63ad-a594-4911-b7a1-09c6ae720137 req-164ab87c-18a5-4c65-b3b4-afcd87b5f74f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032374 Jun 07 09:29:15.400748 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-4a1a5dbe-c46b-4ccf-9bfb-cf36384b6608 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:15.401369 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 95/180] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Jun 7 09:29:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:29:15.402628 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-4a1a5dbe-c46b-4ccf-9bfb-cf36384b6608 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:15.403070 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-4a1a5dbe-c46b-4ccf-9bfb-cf36384b6608 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:15.420355 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writing DB stats nova_cell1:SELECT=100 {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:29:15.544395 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-4a1a5dbe-c46b-4ccf-9bfb-cf36384b6608 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0346f4e3855142059983083e71c2c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c21b1cbbd604d6d9c97ab7c3c788f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:15.552234 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-4a1a5dbe-c46b-4ccf-9bfb-cf36384b6608 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25" status: 200 len: 1362 microversion: 2.1 time: 0.177685 Jun 07 09:29:15.552828 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 86/181] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:15 2022] GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 => generated 1362 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:15.774354 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-b4cc2b05-32f2-49b1-a7be-7afe6f96be23 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:15.775259 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-b4cc2b05-32f2-49b1-a7be-7afe6f96be23 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:15.781710 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b4cc2b05-32f2-49b1-a7be-7afe6f96be23 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:15.782170 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b4cc2b05-32f2-49b1-a7be-7afe6f96be23 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:15.783153 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b4cc2b05-32f2-49b1-a7be-7afe6f96be23 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:15.783444 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b4cc2b05-32f2-49b1-a7be-7afe6f96be23 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:15.784124 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-128b7b33-0c84-47a6-b5b9-d804e79d3562 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:15.784781 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-128b7b33-0c84-47a6-b5b9-d804e79d3562 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 0e41026b-9a96-47df-a158-d8ea485025bd] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:15.791041 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-128b7b33-0c84-47a6-b5b9-d804e79d3562 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:15.791509 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-128b7b33-0c84-47a6-b5b9-d804e79d3562 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:15.794377 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-128b7b33-0c84-47a6-b5b9-d804e79d3562 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:15.794377 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-128b7b33-0c84-47a6-b5b9-d804e79d3562 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:15.924983 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-b4cc2b05-32f2-49b1-a7be-7afe6f96be23 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:15.932490 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-128b7b33-0c84-47a6-b5b9-d804e79d3562 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:15.932777 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-b4cc2b05-32f2-49b1-a7be-7afe6f96be23 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4" status: 200 len: 1321 microversion: 2.1 time: 0.162777 Jun 07 09:29:15.933367 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 96/182] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:15 2022] GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4 => generated 1321 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:15.940617 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-128b7b33-0c84-47a6-b5b9-d804e79d3562 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd" status: 200 len: 1366 microversion: 2.1 time: 0.160428 Jun 07 09:29:15.941211 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 87/183] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:15 2022] GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:29:15.991564 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-108c310e-9c62-448b-b86a-44275df060b6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:15.992398 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-108c310e-9c62-448b-b86a-44275df060b6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:15.999150 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-108c310e-9c62-448b-b86a-44275df060b6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:15.999588 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-108c310e-9c62-448b-b86a-44275df060b6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:16.000436 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-108c310e-9c62-448b-b86a-44275df060b6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:16.000904 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-108c310e-9c62-448b-b86a-44275df060b6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:16.187793 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-108c310e-9c62-448b-b86a-44275df060b6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:16.198370 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-108c310e-9c62-448b-b86a-44275df060b6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:16.200694 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-108c310e-9c62-448b-b86a-44275df060b6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:16.202499 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-108c310e-9c62-448b-b86a-44275df060b6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1405 microversion: 2.20 time: 0.215028 Jun 07 09:29:16.203053 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 97/184] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:29:15 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1405 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:29:16.569413 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-2e3a3e1e-b624-4bc3-b130-6bbe86e3f1e0 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:16.569927 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-2e3a3e1e-b624-4bc3-b130-6bbe86e3f1e0 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:16.577013 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-2e3a3e1e-b624-4bc3-b130-6bbe86e3f1e0 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:16.577454 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-2e3a3e1e-b624-4bc3-b130-6bbe86e3f1e0 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:16.578209 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-2e3a3e1e-b624-4bc3-b130-6bbe86e3f1e0 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:16.578639 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-2e3a3e1e-b624-4bc3-b130-6bbe86e3f1e0 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:16.708338 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-2e3a3e1e-b624-4bc3-b130-6bbe86e3f1e0 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0346f4e3855142059983083e71c2c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c21b1cbbd604d6d9c97ab7c3c788f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:16.715901 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-2e3a3e1e-b624-4bc3-b130-6bbe86e3f1e0 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25" status: 200 len: 1362 microversion: 2.1 time: 0.150380 Jun 07 09:29:16.716461 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 88/185] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:16 2022] GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:16.949831 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-8b390e23-553b-48cc-a5b4-49364ede1b4e tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:16.950481 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-8b390e23-553b-48cc-a5b4-49364ede1b4e tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:16.956641 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-8b390e23-553b-48cc-a5b4-49364ede1b4e tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:16.957086 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-8b390e23-553b-48cc-a5b4-49364ede1b4e tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:16.957840 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-8b390e23-553b-48cc-a5b4-49364ede1b4e tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:16.958274 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-8b390e23-553b-48cc-a5b4-49364ede1b4e tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:16.959479 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-a5741d11-37f8-4dab-a429-f44a28d512a0 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:16.960093 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-a5741d11-37f8-4dab-a429-f44a28d512a0 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 0e41026b-9a96-47df-a158-d8ea485025bd] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:16.966063 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-a5741d11-37f8-4dab-a429-f44a28d512a0 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:16.966505 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-a5741d11-37f8-4dab-a429-f44a28d512a0 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:16.967258 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-a5741d11-37f8-4dab-a429-f44a28d512a0 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:16.967687 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-a5741d11-37f8-4dab-a429-f44a28d512a0 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:17.090029 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-8b390e23-553b-48cc-a5b4-49364ede1b4e tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:17.097971 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-8b390e23-553b-48cc-a5b4-49364ede1b4e tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4" status: 200 len: 1321 microversion: 2.1 time: 0.152003 Jun 07 09:29:17.098538 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 98/186] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:16 2022] GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4 => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:17.132015 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-a5741d11-37f8-4dab-a429-f44a28d512a0 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:17.139509 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-a5741d11-37f8-4dab-a429-f44a28d512a0 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd" status: 200 len: 1366 microversion: 2.1 time: 0.183796 Jun 07 09:29:17.140265 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 89/187] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:16 2022] GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd => generated 1366 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:17.222791 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-bbe8b24d-6558-4616-b7cb-a2e714121de4 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:17.223186 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-bbe8b24d-6558-4616-b7cb-a2e714121de4 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:17.229665 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-bbe8b24d-6558-4616-b7cb-a2e714121de4 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:17.230127 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-bbe8b24d-6558-4616-b7cb-a2e714121de4 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:17.231051 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-bbe8b24d-6558-4616-b7cb-a2e714121de4 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:17.232294 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-bbe8b24d-6558-4616-b7cb-a2e714121de4 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:17.236993 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writing DB stats nova_cell1:SELECT=100 {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:29:17.363297 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-bbe8b24d-6558-4616-b7cb-a2e714121de4 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:17.372896 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-bbe8b24d-6558-4616-b7cb-a2e714121de4 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:17.374483 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-bbe8b24d-6558-4616-b7cb-a2e714121de4 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:17.375711 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-bbe8b24d-6558-4616-b7cb-a2e714121de4 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1405 microversion: 2.20 time: 0.158572 Jun 07 09:29:17.380991 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 99/188] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:29:17 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1405 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:29:17.732802 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-932ebcb3-6d5a-4032-acea-083360931eac tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:17.733611 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-932ebcb3-6d5a-4032-acea-083360931eac tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:17.739753 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-932ebcb3-6d5a-4032-acea-083360931eac tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:17.740284 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-932ebcb3-6d5a-4032-acea-083360931eac tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:17.741154 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-932ebcb3-6d5a-4032-acea-083360931eac tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:17.741716 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-932ebcb3-6d5a-4032-acea-083360931eac tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:17.873261 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-932ebcb3-6d5a-4032-acea-083360931eac tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0346f4e3855142059983083e71c2c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c21b1cbbd604d6d9c97ab7c3c788f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:17.881101 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-932ebcb3-6d5a-4032-acea-083360931eac tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25" status: 200 len: 1362 microversion: 2.1 time: 0.152726 Jun 07 09:29:17.881662 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 90/189] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:17 2022] GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:18.115253 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-d37fc187-31c6-4e6b-8700-a63975c57614 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:18.115894 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-d37fc187-31c6-4e6b-8700-a63975c57614 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:18.122774 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-d37fc187-31c6-4e6b-8700-a63975c57614 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:18.123277 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-d37fc187-31c6-4e6b-8700-a63975c57614 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:18.124086 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-d37fc187-31c6-4e6b-8700-a63975c57614 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:18.124568 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-d37fc187-31c6-4e6b-8700-a63975c57614 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:18.156371 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-884f3c71-d62e-4528-9c09-b7026df39899 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:18.157144 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-884f3c71-d62e-4528-9c09-b7026df39899 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 0e41026b-9a96-47df-a158-d8ea485025bd] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:18.163547 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-884f3c71-d62e-4528-9c09-b7026df39899 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:18.164269 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-884f3c71-d62e-4528-9c09-b7026df39899 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:18.164897 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-884f3c71-d62e-4528-9c09-b7026df39899 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:18.165332 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-884f3c71-d62e-4528-9c09-b7026df39899 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:18.270244 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-d37fc187-31c6-4e6b-8700-a63975c57614 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:18.278630 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-d37fc187-31c6-4e6b-8700-a63975c57614 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4" status: 200 len: 1321 microversion: 2.1 time: 0.167228 Jun 07 09:29:18.288972 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 100/190] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:18 2022] GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4 => generated 1321 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:18.311120 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-884f3c71-d62e-4528-9c09-b7026df39899 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:18.316532 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-884f3c71-d62e-4528-9c09-b7026df39899 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd" status: 200 len: 1366 microversion: 2.1 time: 0.163945 Jun 07 09:29:18.317144 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 91/191] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:18 2022] GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:29:18.393725 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-e9d5a270-8867-4ad8-a272-afd0490db2a0 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:18.394334 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-e9d5a270-8867-4ad8-a272-afd0490db2a0 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:18.401593 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-e9d5a270-8867-4ad8-a272-afd0490db2a0 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:18.401593 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-e9d5a270-8867-4ad8-a272-afd0490db2a0 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:18.401593 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-e9d5a270-8867-4ad8-a272-afd0490db2a0 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:18.401920 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-e9d5a270-8867-4ad8-a272-afd0490db2a0 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:18.527682 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-e9d5a270-8867-4ad8-a272-afd0490db2a0 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:18.536140 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-e9d5a270-8867-4ad8-a272-afd0490db2a0 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:18.537661 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-e9d5a270-8867-4ad8-a272-afd0490db2a0 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:18.538756 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-e9d5a270-8867-4ad8-a272-afd0490db2a0 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1405 microversion: 2.20 time: 0.149010 Jun 07 09:29:18.539306 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 101/192] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:29:18 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1405 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 09:29:18.897348 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-70eec53e-becc-410d-8fed-7b7d6a2352de tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:18.898069 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-70eec53e-becc-410d-8fed-7b7d6a2352de tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:18.904891 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-70eec53e-becc-410d-8fed-7b7d6a2352de tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:18.905346 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-70eec53e-becc-410d-8fed-7b7d6a2352de tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:18.906141 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-70eec53e-becc-410d-8fed-7b7d6a2352de tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:18.906580 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-70eec53e-becc-410d-8fed-7b7d6a2352de tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:19.041611 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-70eec53e-becc-410d-8fed-7b7d6a2352de tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0346f4e3855142059983083e71c2c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c21b1cbbd604d6d9c97ab7c3c788f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:19.051422 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-70eec53e-becc-410d-8fed-7b7d6a2352de tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25" status: 200 len: 1362 microversion: 2.1 time: 0.157725 Jun 07 09:29:19.051885 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 92/193] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:18 2022] GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:19.295362 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-4e127255-065f-4cb2-8de4-df71cee1e9fb tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:19.295963 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-4e127255-065f-4cb2-8de4-df71cee1e9fb tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:19.301864 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-4e127255-065f-4cb2-8de4-df71cee1e9fb tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:19.302361 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-4e127255-065f-4cb2-8de4-df71cee1e9fb tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:19.303081 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-4e127255-065f-4cb2-8de4-df71cee1e9fb tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:19.303881 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-4e127255-065f-4cb2-8de4-df71cee1e9fb tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:19.340558 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-0c387f26-d24c-49dd-a621-7283d266a586 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:19.341166 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-0c387f26-d24c-49dd-a621-7283d266a586 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 0e41026b-9a96-47df-a158-d8ea485025bd] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:19.349894 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-0c387f26-d24c-49dd-a621-7283d266a586 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:19.351524 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-0c387f26-d24c-49dd-a621-7283d266a586 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:19.352313 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-0c387f26-d24c-49dd-a621-7283d266a586 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:19.352816 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-0c387f26-d24c-49dd-a621-7283d266a586 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:19.467819 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-4e127255-065f-4cb2-8de4-df71cee1e9fb tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:19.475461 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-4e127255-065f-4cb2-8de4-df71cee1e9fb tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4" status: 200 len: 1321 microversion: 2.1 time: 0.183910 Jun 07 09:29:19.476036 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 102/194] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:19 2022] GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4 => generated 1321 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:19.516769 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-0c387f26-d24c-49dd-a621-7283d266a586 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:19.524393 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-0c387f26-d24c-49dd-a621-7283d266a586 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd" status: 200 len: 1366 microversion: 2.1 time: 0.187775 Jun 07 09:29:19.524993 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 93/195] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:19 2022] GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd => generated 1366 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:29:19.557198 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-65375da8-6c46-47f0-9d5d-cac1687dfaf9 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:19.557907 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-65375da8-6c46-47f0-9d5d-cac1687dfaf9 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:19.564417 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-65375da8-6c46-47f0-9d5d-cac1687dfaf9 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:19.564897 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-65375da8-6c46-47f0-9d5d-cac1687dfaf9 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:19.565658 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-65375da8-6c46-47f0-9d5d-cac1687dfaf9 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:19.566091 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-65375da8-6c46-47f0-9d5d-cac1687dfaf9 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:19.692329 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-65375da8-6c46-47f0-9d5d-cac1687dfaf9 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:19.701193 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-65375da8-6c46-47f0-9d5d-cac1687dfaf9 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:19.702937 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-65375da8-6c46-47f0-9d5d-cac1687dfaf9 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:19.704072 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-65375da8-6c46-47f0-9d5d-cac1687dfaf9 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1405 microversion: 2.20 time: 0.150712 Jun 07 09:29:19.709292 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 103/196] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:29:19 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1405 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:29:20.067876 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-4df8a2a4-b892-4d29-8f34-d64136960ad7 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:20.068531 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-4df8a2a4-b892-4d29-8f34-d64136960ad7 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:20.074676 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-4df8a2a4-b892-4d29-8f34-d64136960ad7 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:20.075127 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-4df8a2a4-b892-4d29-8f34-d64136960ad7 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:20.076544 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-4df8a2a4-b892-4d29-8f34-d64136960ad7 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:20.077050 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-4df8a2a4-b892-4d29-8f34-d64136960ad7 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:20.205772 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-4df8a2a4-b892-4d29-8f34-d64136960ad7 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0346f4e3855142059983083e71c2c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c21b1cbbd604d6d9c97ab7c3c788f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:20.213081 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-4df8a2a4-b892-4d29-8f34-d64136960ad7 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25" status: 200 len: 1362 microversion: 2.1 time: 0.149116 Jun 07 09:29:20.213636 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 94/197] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:20 2022] GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:29:20.492463 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-e40f662b-676a-4850-ab37-51a376953915 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:20.493160 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-e40f662b-676a-4850-ab37-51a376953915 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:20.499825 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-e40f662b-676a-4850-ab37-51a376953915 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:20.500276 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-e40f662b-676a-4850-ab37-51a376953915 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:20.501061 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-e40f662b-676a-4850-ab37-51a376953915 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:20.501499 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-e40f662b-676a-4850-ab37-51a376953915 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:20.541246 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-32ac413b-1296-45dd-9d76-1dbefcfcc980 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:20.541860 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-32ac413b-1296-45dd-9d76-1dbefcfcc980 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 0e41026b-9a96-47df-a158-d8ea485025bd] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:20.548388 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-32ac413b-1296-45dd-9d76-1dbefcfcc980 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:20.548870 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-32ac413b-1296-45dd-9d76-1dbefcfcc980 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:20.549655 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-32ac413b-1296-45dd-9d76-1dbefcfcc980 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:20.550083 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-32ac413b-1296-45dd-9d76-1dbefcfcc980 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:20.637412 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-e40f662b-676a-4850-ab37-51a376953915 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:20.646053 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-e40f662b-676a-4850-ab37-51a376953915 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4" status: 200 len: 1321 microversion: 2.1 time: 0.157225 Jun 07 09:29:20.652636 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 104/198] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:20 2022] GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4 => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:20.690360 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-32ac413b-1296-45dd-9d76-1dbefcfcc980 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:20.698229 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-32ac413b-1296-45dd-9d76-1dbefcfcc980 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd" status: 200 len: 1366 microversion: 2.1 time: 0.160723 Jun 07 09:29:20.698797 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 95/199] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:20 2022] GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:29:20.723151 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-9ce40ecb-443f-4402-8f66-85c4259218b8 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:20.723828 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-9ce40ecb-443f-4402-8f66-85c4259218b8 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:20.729991 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-9ce40ecb-443f-4402-8f66-85c4259218b8 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:20.730437 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-9ce40ecb-443f-4402-8f66-85c4259218b8 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:20.731183 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-9ce40ecb-443f-4402-8f66-85c4259218b8 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:20.732766 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-9ce40ecb-443f-4402-8f66-85c4259218b8 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:20.861787 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-9ce40ecb-443f-4402-8f66-85c4259218b8 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:20.869711 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-9ce40ecb-443f-4402-8f66-85c4259218b8 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:20.871228 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-9ce40ecb-443f-4402-8f66-85c4259218b8 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:20.872908 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-9ce40ecb-443f-4402-8f66-85c4259218b8 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1405 microversion: 2.20 time: 0.153647 Jun 07 09:29:20.873470 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 105/200] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:29:20 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1405 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:29:21.229877 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-c74262f7-868f-43ee-b3f9-074d06241045 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:21.230450 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-c74262f7-868f-43ee-b3f9-074d06241045 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:21.237392 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-c74262f7-868f-43ee-b3f9-074d06241045 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:21.237831 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-c74262f7-868f-43ee-b3f9-074d06241045 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:21.238579 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-c74262f7-868f-43ee-b3f9-074d06241045 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:21.239015 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-c74262f7-868f-43ee-b3f9-074d06241045 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:21.391502 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-c74262f7-868f-43ee-b3f9-074d06241045 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0346f4e3855142059983083e71c2c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c21b1cbbd604d6d9c97ab7c3c788f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:21.399165 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-c74262f7-868f-43ee-b3f9-074d06241045 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25" status: 200 len: 1362 microversion: 2.1 time: 0.173226 Jun 07 09:29:21.399731 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 96/201] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:21 2022] GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:21.512782 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-1cf65ff0-788c-4bc3-8a1a-bba2f8312369 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8392c5c9-e3f8-4209-9ba7-f34c37173c94"}} {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:29:21.512782 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-1cf65ff0-788c-4bc3-8a1a-bba2f8312369 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] [instance: 90803094-e09d-4c65-9aba-88d612d0dafd] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:21.519024 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-1cf65ff0-788c-4bc3-8a1a-bba2f8312369 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:21.521870 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-1cf65ff0-788c-4bc3-8a1a-bba2f8312369 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:21.523021 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-1cf65ff0-788c-4bc3-8a1a-bba2f8312369 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:21.523931 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-1cf65ff0-788c-4bc3-8a1a-bba2f8312369 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:21.665692 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-d4e4d762-4794-4052-8aa0-7679c48e3353 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:21.666358 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-d4e4d762-4794-4052-8aa0-7679c48e3353 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:21.673780 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-d4e4d762-4794-4052-8aa0-7679c48e3353 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:21.674300 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-d4e4d762-4794-4052-8aa0-7679c48e3353 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:21.675073 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-d4e4d762-4794-4052-8aa0-7679c48e3353 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:21.675908 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-d4e4d762-4794-4052-8aa0-7679c48e3353 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:21.835478 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-d4e4d762-4794-4052-8aa0-7679c48e3353 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:21.843009 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-d4e4d762-4794-4052-8aa0-7679c48e3353 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4" status: 200 len: 1321 microversion: 2.1 time: 0.182799 Jun 07 09:29:21.843567 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 97/202] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:21 2022] GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4 => generated 1321 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:21.847935 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-29f68d97-4c8a-4e5d-ae99-feb64c9a1243 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:21.881500 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-29f68d97-4c8a-4e5d-ae99-feb64c9a1243 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 0e41026b-9a96-47df-a158-d8ea485025bd] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:21.881500 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-29f68d97-4c8a-4e5d-ae99-feb64c9a1243 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:21.881500 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-29f68d97-4c8a-4e5d-ae99-feb64c9a1243 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:21.881500 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-29f68d97-4c8a-4e5d-ae99-feb64c9a1243 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:21.881875 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-29f68d97-4c8a-4e5d-ae99-feb64c9a1243 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:22.041327 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-29f68d97-4c8a-4e5d-ae99-feb64c9a1243 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:22.049209 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-29f68d97-4c8a-4e5d-ae99-feb64c9a1243 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd" status: 200 len: 1366 microversion: 2.1 time: 0.204675 Jun 07 09:29:22.049969 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 98/203] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:21 2022] GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd => generated 1366 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:22.054397 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-62cd6352-f4d1-4663-8547-2558c8e52afc tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:22.054998 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-62cd6352-f4d1-4663-8547-2558c8e52afc tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:22.061264 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-62cd6352-f4d1-4663-8547-2558c8e52afc tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:22.061706 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-62cd6352-f4d1-4663-8547-2558c8e52afc tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:22.062464 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-62cd6352-f4d1-4663-8547-2558c8e52afc tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:22.062893 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-62cd6352-f4d1-4663-8547-2558c8e52afc tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:22.413961 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-62cd6352-f4d1-4663-8547-2558c8e52afc tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:22.423152 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-62cd6352-f4d1-4663-8547-2558c8e52afc tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:22.424696 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-62cd6352-f4d1-4663-8547-2558c8e52afc tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:22.425807 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-62cd6352-f4d1-4663-8547-2558c8e52afc tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1405 microversion: 2.20 time: 0.375047 Jun 07 09:29:22.426360 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 99/204] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:29:22 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1405 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:29:22.431219 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-6426875f-a5e6-477f-9114-da91dd1f09ab tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:22.432992 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-6426875f-a5e6-477f-9114-da91dd1f09ab tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:22.437904 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-6426875f-a5e6-477f-9114-da91dd1f09ab tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:22.438374 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-6426875f-a5e6-477f-9114-da91dd1f09ab tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:22.439193 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-6426875f-a5e6-477f-9114-da91dd1f09ab tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:22.439627 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-6426875f-a5e6-477f-9114-da91dd1f09ab tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:22.566873 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-6426875f-a5e6-477f-9114-da91dd1f09ab tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0346f4e3855142059983083e71c2c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c21b1cbbd604d6d9c97ab7c3c788f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:22.578734 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-6426875f-a5e6-477f-9114-da91dd1f09ab tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25" status: 200 len: 1362 microversion: 2.1 time: 0.150787 Jun 07 09:29:22.582212 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 100/205] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:22 2022] GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:22.888949 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-90cf77e2-e43d-4059-ab42-4a7b4013b749 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:22.889564 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-90cf77e2-e43d-4059-ab42-4a7b4013b749 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:22.897870 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-90cf77e2-e43d-4059-ab42-4a7b4013b749 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:22.898322 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-90cf77e2-e43d-4059-ab42-4a7b4013b749 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:22.901993 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-90cf77e2-e43d-4059-ab42-4a7b4013b749 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:22.902525 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-90cf77e2-e43d-4059-ab42-4a7b4013b749 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:23.029509 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-90cf77e2-e43d-4059-ab42-4a7b4013b749 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:23.037326 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-90cf77e2-e43d-4059-ab42-4a7b4013b749 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4" status: 200 len: 1321 microversion: 2.1 time: 0.152148 Jun 07 09:29:23.037817 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 101/206] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:22 2022] GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4 => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:23.066581 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-ad0f825d-fb83-4b81-998e-ef08b1faa72d tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:23.067252 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-ad0f825d-fb83-4b81-998e-ef08b1faa72d tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 0e41026b-9a96-47df-a158-d8ea485025bd] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:23.073457 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-ad0f825d-fb83-4b81-998e-ef08b1faa72d tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:23.073908 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-ad0f825d-fb83-4b81-998e-ef08b1faa72d tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:23.074662 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-ad0f825d-fb83-4b81-998e-ef08b1faa72d tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:23.075098 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-ad0f825d-fb83-4b81-998e-ef08b1faa72d tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:23.217313 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-ad0f825d-fb83-4b81-998e-ef08b1faa72d tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:23.225037 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-ad0f825d-fb83-4b81-998e-ef08b1faa72d tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd" status: 200 len: 1366 microversion: 2.1 time: 0.162203 Jun 07 09:29:23.225601 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 102/207] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:23 2022] GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:23.451213 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-9c90c1d7-7d73-42b5-933b-eb6729fc8fa7 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:23.452109 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-9c90c1d7-7d73-42b5-933b-eb6729fc8fa7 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:23.458781 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-9c90c1d7-7d73-42b5-933b-eb6729fc8fa7 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:23.459780 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-9c90c1d7-7d73-42b5-933b-eb6729fc8fa7 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:23.460836 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-9c90c1d7-7d73-42b5-933b-eb6729fc8fa7 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:23.462101 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-9c90c1d7-7d73-42b5-933b-eb6729fc8fa7 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:23.467508 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writing DB stats nova_cell1:SELECT=100 {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:29:23.619185 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-9c90c1d7-7d73-42b5-933b-eb6729fc8fa7 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:23.627230 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-9c90c1d7-7d73-42b5-933b-eb6729fc8fa7 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:23.628935 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-9c90c1d7-7d73-42b5-933b-eb6729fc8fa7 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:23.630143 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-9c90c1d7-7d73-42b5-933b-eb6729fc8fa7 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1405 microversion: 2.20 time: 0.183963 Jun 07 09:29:23.630706 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 103/208] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:29:23 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1405 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 09:29:23.639218 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-2f017c14-b246-4b24-a8ce-e0b34802370b tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:23.639218 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-2f017c14-b246-4b24-a8ce-e0b34802370b tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:23.642423 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-2f017c14-b246-4b24-a8ce-e0b34802370b tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:23.642872 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-2f017c14-b246-4b24-a8ce-e0b34802370b tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:23.643626 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-2f017c14-b246-4b24-a8ce-e0b34802370b tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:23.644057 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-2f017c14-b246-4b24-a8ce-e0b34802370b tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:23.824042 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-2f017c14-b246-4b24-a8ce-e0b34802370b tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0346f4e3855142059983083e71c2c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c21b1cbbd604d6d9c97ab7c3c788f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:23.831812 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-2f017c14-b246-4b24-a8ce-e0b34802370b tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25" status: 200 len: 1362 microversion: 2.1 time: 0.200104 Jun 07 09:29:23.832380 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 104/209] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:23 2022] GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 => generated 1362 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:24.056273 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-5722b301-90aa-4b20-a0ba-83b1f03cd773 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:24.057137 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-5722b301-90aa-4b20-a0ba-83b1f03cd773 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:24.064864 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-5722b301-90aa-4b20-a0ba-83b1f03cd773 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:24.065497 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-5722b301-90aa-4b20-a0ba-83b1f03cd773 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:24.068060 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-5722b301-90aa-4b20-a0ba-83b1f03cd773 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:24.068060 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-5722b301-90aa-4b20-a0ba-83b1f03cd773 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:24.195863 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-5722b301-90aa-4b20-a0ba-83b1f03cd773 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:24.203666 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-5722b301-90aa-4b20-a0ba-83b1f03cd773 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4" status: 200 len: 1321 microversion: 2.1 time: 0.152024 Jun 07 09:29:24.204269 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 105/210] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:24 2022] GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4 => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:29:24.232286 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-1cf65ff0-788c-4bc3-8a1a-bba2f8312369 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] 10.222.0.57 "POST /compute/v2.1/servers/90803094-e09d-4c65-9aba-88d612d0dafd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.724854 Jun 07 09:29:24.233784 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 106/211] 10.222.0.57 () {60 vars in 1322 bytes} [Tue Jun 7 09:29:21 2022] POST /compute/v2.1/servers/90803094-e09d-4c65-9aba-88d612d0dafd/os-volume_attachments => generated 194 bytes in 2726 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:29:24.249082 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-18a37ec6-140d-44e4-bea8-ce50a83a813f tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:24.263989 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-18a37ec6-140d-44e4-bea8-ce50a83a813f tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 0e41026b-9a96-47df-a158-d8ea485025bd] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:24.276664 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-18a37ec6-140d-44e4-bea8-ce50a83a813f tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:24.277867 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-18a37ec6-140d-44e4-bea8-ce50a83a813f tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:24.279534 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-18a37ec6-140d-44e4-bea8-ce50a83a813f tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:24.280080 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-18a37ec6-140d-44e4-bea8-ce50a83a813f tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:24.421886 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-18a37ec6-140d-44e4-bea8-ce50a83a813f tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:24.429504 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-18a37ec6-140d-44e4-bea8-ce50a83a813f tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd" status: 200 len: 1366 microversion: 2.1 time: 0.187403 Jun 07 09:29:24.430420 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 106/212] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:24 2022] GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd => generated 1366 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:24.650040 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-0db51d8c-be22-4f76-9f39-f3dc9b909425 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:24.650978 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-0db51d8c-be22-4f76-9f39-f3dc9b909425 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:24.658168 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-0db51d8c-be22-4f76-9f39-f3dc9b909425 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:24.661493 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-0db51d8c-be22-4f76-9f39-f3dc9b909425 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:24.661493 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-0db51d8c-be22-4f76-9f39-f3dc9b909425 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:24.661493 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-0db51d8c-be22-4f76-9f39-f3dc9b909425 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:24.793734 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-0db51d8c-be22-4f76-9f39-f3dc9b909425 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:24.802066 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-0db51d8c-be22-4f76-9f39-f3dc9b909425 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:24.804139 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-0db51d8c-be22-4f76-9f39-f3dc9b909425 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:24.805323 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-0db51d8c-be22-4f76-9f39-f3dc9b909425 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1405 microversion: 2.20 time: 0.159958 Jun 07 09:29:24.806180 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 107/213] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:29:24 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1405 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:29:24.850338 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-5a620725-0edb-463c-a343-4399ff3e6ed0 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:24.851355 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-5a620725-0edb-463c-a343-4399ff3e6ed0 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:24.858741 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-5a620725-0edb-463c-a343-4399ff3e6ed0 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:24.859188 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-5a620725-0edb-463c-a343-4399ff3e6ed0 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:24.859984 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-5a620725-0edb-463c-a343-4399ff3e6ed0 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:24.860416 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-5a620725-0edb-463c-a343-4399ff3e6ed0 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:25.008087 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-5a620725-0edb-463c-a343-4399ff3e6ed0 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0346f4e3855142059983083e71c2c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c21b1cbbd604d6d9c97ab7c3c788f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:25.012764 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-5a620725-0edb-463c-a343-4399ff3e6ed0 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25" status: 200 len: 1362 microversion: 2.1 time: 0.167447 Jun 07 09:29:25.013337 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 107/214] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:24 2022] GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:25.222435 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-89bf50bb-5967-49df-b512-e6957bc64610 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:25.223116 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-89bf50bb-5967-49df-b512-e6957bc64610 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:25.229260 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-89bf50bb-5967-49df-b512-e6957bc64610 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:25.229707 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-89bf50bb-5967-49df-b512-e6957bc64610 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:25.230566 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-89bf50bb-5967-49df-b512-e6957bc64610 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:25.230884 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-89bf50bb-5967-49df-b512-e6957bc64610 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:25.387338 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-89bf50bb-5967-49df-b512-e6957bc64610 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:25.405457 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-89bf50bb-5967-49df-b512-e6957bc64610 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4" status: 200 len: 1321 microversion: 2.1 time: 0.180192 Jun 07 09:29:25.405457 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 108/215] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:25 2022] GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4 => generated 1321 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:25.446521 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-8b1d5b30-2a59-42c5-b634-2002668ec3a0 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:25.447322 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-8b1d5b30-2a59-42c5-b634-2002668ec3a0 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 0e41026b-9a96-47df-a158-d8ea485025bd] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:25.453309 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-8b1d5b30-2a59-42c5-b634-2002668ec3a0 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:25.453783 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-8b1d5b30-2a59-42c5-b634-2002668ec3a0 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:25.454508 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-8b1d5b30-2a59-42c5-b634-2002668ec3a0 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:25.454938 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-8b1d5b30-2a59-42c5-b634-2002668ec3a0 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:25.590119 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-8b1d5b30-2a59-42c5-b634-2002668ec3a0 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:25.601947 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-8b1d5b30-2a59-42c5-b634-2002668ec3a0 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd" status: 200 len: 1366 microversion: 2.1 time: 0.155286 Jun 07 09:29:25.601947 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 108/216] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:25 2022] GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:25.822956 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-1c506cd1-58d7-4f37-8c38-50cb6ae5bfd3 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:25.823564 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-1c506cd1-58d7-4f37-8c38-50cb6ae5bfd3 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:25.830330 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-1c506cd1-58d7-4f37-8c38-50cb6ae5bfd3 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:25.830780 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-1c506cd1-58d7-4f37-8c38-50cb6ae5bfd3 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:25.831544 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-1c506cd1-58d7-4f37-8c38-50cb6ae5bfd3 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:25.831977 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-1c506cd1-58d7-4f37-8c38-50cb6ae5bfd3 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:25.964987 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-1c506cd1-58d7-4f37-8c38-50cb6ae5bfd3 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:25.973130 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-1c506cd1-58d7-4f37-8c38-50cb6ae5bfd3 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:25.974643 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-1c506cd1-58d7-4f37-8c38-50cb6ae5bfd3 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:25.975751 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-1c506cd1-58d7-4f37-8c38-50cb6ae5bfd3 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1405 microversion: 2.20 time: 0.156605 Jun 07 09:29:25.976366 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 109/217] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:29:25 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1405 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:29:26.030021 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-129b888b-cf5e-494d-910d-d73e98c7984a tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:26.030516 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-129b888b-cf5e-494d-910d-d73e98c7984a tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:26.036494 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-129b888b-cf5e-494d-910d-d73e98c7984a tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:26.037009 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-129b888b-cf5e-494d-910d-d73e98c7984a tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:26.037774 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-129b888b-cf5e-494d-910d-d73e98c7984a tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:26.038208 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-129b888b-cf5e-494d-910d-d73e98c7984a tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:26.214778 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-129b888b-cf5e-494d-910d-d73e98c7984a tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0346f4e3855142059983083e71c2c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c21b1cbbd604d6d9c97ab7c3c788f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:26.223163 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-129b888b-cf5e-494d-910d-d73e98c7984a tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25" status: 200 len: 1362 microversion: 2.1 time: 0.197571 Jun 07 09:29:26.229472 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 109/218] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:26 2022] GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 => generated 1362 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:26.417764 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-e6324bae-4a99-44d8-a7d3-cc9e22a65702 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:26.419067 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-e6324bae-4a99-44d8-a7d3-cc9e22a65702 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:26.425171 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-e6324bae-4a99-44d8-a7d3-cc9e22a65702 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:26.425623 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-e6324bae-4a99-44d8-a7d3-cc9e22a65702 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:26.429459 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-e6324bae-4a99-44d8-a7d3-cc9e22a65702 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:26.429459 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-e6324bae-4a99-44d8-a7d3-cc9e22a65702 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:26.552380 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-e6324bae-4a99-44d8-a7d3-cc9e22a65702 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:26.560227 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-e6324bae-4a99-44d8-a7d3-cc9e22a65702 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4" status: 200 len: 1321 microversion: 2.1 time: 0.145844 Jun 07 09:29:26.560821 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 110/219] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:26 2022] GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4 => generated 1321 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:26.617554 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-f868681b-22c4-4364-a67b-020869a2c526 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:26.618256 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-f868681b-22c4-4364-a67b-020869a2c526 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 0e41026b-9a96-47df-a158-d8ea485025bd] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:26.625051 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-f868681b-22c4-4364-a67b-020869a2c526 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:26.625578 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-f868681b-22c4-4364-a67b-020869a2c526 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:26.626405 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-f868681b-22c4-4364-a67b-020869a2c526 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:26.626904 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-f868681b-22c4-4364-a67b-020869a2c526 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:26.756804 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-f868681b-22c4-4364-a67b-020869a2c526 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:26.764652 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-f868681b-22c4-4364-a67b-020869a2c526 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd" status: 200 len: 1366 microversion: 2.1 time: 0.150901 Jun 07 09:29:26.765317 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 110/220] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:26 2022] GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:29:26.999283 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-a9defa51-cb6a-4838-b192-2f0d2afc5631 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:27.000697 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-a9defa51-cb6a-4838-b192-2f0d2afc5631 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:27.007411 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-a9defa51-cb6a-4838-b192-2f0d2afc5631 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:27.007856 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-a9defa51-cb6a-4838-b192-2f0d2afc5631 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:27.008671 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-a9defa51-cb6a-4838-b192-2f0d2afc5631 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:27.009267 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-a9defa51-cb6a-4838-b192-2f0d2afc5631 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:27.169777 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-a9defa51-cb6a-4838-b192-2f0d2afc5631 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:27.177717 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-a9defa51-cb6a-4838-b192-2f0d2afc5631 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:27.183467 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-a9defa51-cb6a-4838-b192-2f0d2afc5631 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:27.183467 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-a9defa51-cb6a-4838-b192-2f0d2afc5631 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1405 microversion: 2.20 time: 0.185000 Jun 07 09:29:27.183467 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 111/221] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:29:26 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1405 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:29:27.239954 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-4d60af72-e7ca-4fb3-bab1-5b5b4fb51268 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:27.240486 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-4d60af72-e7ca-4fb3-bab1-5b5b4fb51268 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:27.247001 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-4d60af72-e7ca-4fb3-bab1-5b5b4fb51268 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:27.247937 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-4d60af72-e7ca-4fb3-bab1-5b5b4fb51268 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:27.248959 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-4d60af72-e7ca-4fb3-bab1-5b5b4fb51268 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:27.249603 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-4d60af72-e7ca-4fb3-bab1-5b5b4fb51268 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:27.396400 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-4d60af72-e7ca-4fb3-bab1-5b5b4fb51268 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0346f4e3855142059983083e71c2c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c21b1cbbd604d6d9c97ab7c3c788f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:27.404854 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-4d60af72-e7ca-4fb3-bab1-5b5b4fb51268 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25" status: 200 len: 1362 microversion: 2.1 time: 0.168665 Jun 07 09:29:27.405717 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 111/222] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:27 2022] GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:27.577235 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-560ae428-079b-4cc4-8e13-a8d0b1307c3f tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:27.578177 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-560ae428-079b-4cc4-8e13-a8d0b1307c3f tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:27.587478 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-560ae428-079b-4cc4-8e13-a8d0b1307c3f tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:27.587911 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-560ae428-079b-4cc4-8e13-a8d0b1307c3f tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:27.588753 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-560ae428-079b-4cc4-8e13-a8d0b1307c3f tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:27.589152 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-560ae428-079b-4cc4-8e13-a8d0b1307c3f tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:27.729973 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-560ae428-079b-4cc4-8e13-a8d0b1307c3f tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:27.738248 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-560ae428-079b-4cc4-8e13-a8d0b1307c3f tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4" status: 200 len: 1321 microversion: 2.1 time: 0.165982 Jun 07 09:29:27.738807 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 112/223] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:27 2022] GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4 => generated 1321 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:27.781975 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-e6fffe44-9aeb-4df3-968a-e770414b1801 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:27.782662 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-e6fffe44-9aeb-4df3-968a-e770414b1801 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 0e41026b-9a96-47df-a158-d8ea485025bd] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:27.788606 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-e6fffe44-9aeb-4df3-968a-e770414b1801 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:27.789056 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-e6fffe44-9aeb-4df3-968a-e770414b1801 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:27.789818 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-e6fffe44-9aeb-4df3-968a-e770414b1801 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:27.790237 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-e6fffe44-9aeb-4df3-968a-e770414b1801 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:27.929152 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-e6fffe44-9aeb-4df3-968a-e770414b1801 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:27.938170 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-e6fffe44-9aeb-4df3-968a-e770414b1801 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd" status: 200 len: 1366 microversion: 2.1 time: 0.160537 Jun 07 09:29:27.938988 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 112/224] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:27 2022] GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:28.198519 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-16be8e2b-bb22-4baf-bda0-108ec2b5b9a6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:28.199158 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-16be8e2b-bb22-4baf-bda0-108ec2b5b9a6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:28.205627 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-16be8e2b-bb22-4baf-bda0-108ec2b5b9a6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:28.206229 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-16be8e2b-bb22-4baf-bda0-108ec2b5b9a6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:28.206993 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-16be8e2b-bb22-4baf-bda0-108ec2b5b9a6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:28.207433 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-16be8e2b-bb22-4baf-bda0-108ec2b5b9a6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:28.334808 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-16be8e2b-bb22-4baf-bda0-108ec2b5b9a6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:28.344494 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-16be8e2b-bb22-4baf-bda0-108ec2b5b9a6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:28.346493 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-16be8e2b-bb22-4baf-bda0-108ec2b5b9a6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:28.347607 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-16be8e2b-bb22-4baf-bda0-108ec2b5b9a6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1405 microversion: 2.20 time: 0.152984 Jun 07 09:29:28.348369 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 113/225] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:29:28 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1405 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:29:28.422160 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-22ba4265-e074-4a19-bd38-bd6ec2255514 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:28.422814 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-22ba4265-e074-4a19-bd38-bd6ec2255514 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:28.429064 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-22ba4265-e074-4a19-bd38-bd6ec2255514 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:28.429507 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-22ba4265-e074-4a19-bd38-bd6ec2255514 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:28.430417 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-22ba4265-e074-4a19-bd38-bd6ec2255514 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:28.430892 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-22ba4265-e074-4a19-bd38-bd6ec2255514 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:28.609241 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-22ba4265-e074-4a19-bd38-bd6ec2255514 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0346f4e3855142059983083e71c2c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c21b1cbbd604d6d9c97ab7c3c788f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:28.617159 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-22ba4265-e074-4a19-bd38-bd6ec2255514 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25" status: 200 len: 1362 microversion: 2.1 time: 0.199002 Jun 07 09:29:28.618240 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 113/226] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:28 2022] GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 => generated 1362 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:29:28.755122 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-f2f7c7d1-7b2c-46b4-b61f-397552572153 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:28.755649 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-f2f7c7d1-7b2c-46b4-b61f-397552572153 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:28.762049 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-f2f7c7d1-7b2c-46b4-b61f-397552572153 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:28.763297 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-f2f7c7d1-7b2c-46b4-b61f-397552572153 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:28.763297 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-f2f7c7d1-7b2c-46b4-b61f-397552572153 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:28.763734 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-f2f7c7d1-7b2c-46b4-b61f-397552572153 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:28.779823 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:29:28.953614 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-f2f7c7d1-7b2c-46b4-b61f-397552572153 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:28.955238 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-c213102a-0b4e-4cf7-8973-3895d4f6ec64 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:28.955828 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-c213102a-0b4e-4cf7-8973-3895d4f6ec64 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 0e41026b-9a96-47df-a158-d8ea485025bd] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:28.961042 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-f2f7c7d1-7b2c-46b4-b61f-397552572153 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4" status: 200 len: 1321 microversion: 2.1 time: 0.209849 Jun 07 09:29:28.961607 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 114/227] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:28 2022] GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4 => generated 1321 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:28.961942 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-c213102a-0b4e-4cf7-8973-3895d4f6ec64 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:28.962386 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-c213102a-0b4e-4cf7-8973-3895d4f6ec64 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:28.963146 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-c213102a-0b4e-4cf7-8973-3895d4f6ec64 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:28.963576 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-c213102a-0b4e-4cf7-8973-3895d4f6ec64 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:29.095420 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-c213102a-0b4e-4cf7-8973-3895d4f6ec64 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:29.102942 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-c213102a-0b4e-4cf7-8973-3895d4f6ec64 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd" status: 200 len: 1366 microversion: 2.1 time: 0.151587 Jun 07 09:29:29.103507 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 114/228] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:28 2022] GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:29:29.367189 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-a1d6f205-a84b-47c0-9490-9fa19044f590 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:29.367789 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-a1d6f205-a84b-47c0-9490-9fa19044f590 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:29.389195 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-a1d6f205-a84b-47c0-9490-9fa19044f590 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:29.390211 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-a1d6f205-a84b-47c0-9490-9fa19044f590 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:29.391458 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-a1d6f205-a84b-47c0-9490-9fa19044f590 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:29.391898 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-a1d6f205-a84b-47c0-9490-9fa19044f590 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:29.634822 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-f8f9a6be-7c81-4182-82ca-260758070adc tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:29.635692 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-f8f9a6be-7c81-4182-82ca-260758070adc tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:29.656540 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-a1d6f205-a84b-47c0-9490-9fa19044f590 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:29.656813 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-f8f9a6be-7c81-4182-82ca-260758070adc tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:29.657125 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-f8f9a6be-7c81-4182-82ca-260758070adc tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:29.658455 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-f8f9a6be-7c81-4182-82ca-260758070adc tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:29.658929 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-f8f9a6be-7c81-4182-82ca-260758070adc tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:29.663111 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-a1d6f205-a84b-47c0-9490-9fa19044f590 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:29.664645 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-a1d6f205-a84b-47c0-9490-9fa19044f590 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:29.672086 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-a1d6f205-a84b-47c0-9490-9fa19044f590 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1405 microversion: 2.20 time: 0.303019 Jun 07 09:29:29.672086 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 115/229] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:29:29 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1405 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:29:29.843289 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-f8f9a6be-7c81-4182-82ca-260758070adc tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0346f4e3855142059983083e71c2c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c21b1cbbd604d6d9c97ab7c3c788f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:29.851557 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-f8f9a6be-7c81-4182-82ca-260758070adc tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25" status: 200 len: 1362 microversion: 2.1 time: 0.220822 Jun 07 09:29:29.852111 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 115/230] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:29 2022] GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 => generated 1362 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:29.979555 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-abfb0c2f-b1b0-4573-aaab-5a1889e903f4 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:29.980260 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-abfb0c2f-b1b0-4573-aaab-5a1889e903f4 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:29.986706 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-abfb0c2f-b1b0-4573-aaab-5a1889e903f4 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:29.987222 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-abfb0c2f-b1b0-4573-aaab-5a1889e903f4 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:29.988046 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-abfb0c2f-b1b0-4573-aaab-5a1889e903f4 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:29.988568 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-abfb0c2f-b1b0-4573-aaab-5a1889e903f4 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:30.120158 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-fdf7a930-37f7-4fde-b92c-3e2d92c2d0cb tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:30.122948 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-fdf7a930-37f7-4fde-b92c-3e2d92c2d0cb tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 0e41026b-9a96-47df-a158-d8ea485025bd] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:30.129672 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-fdf7a930-37f7-4fde-b92c-3e2d92c2d0cb tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:30.129832 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-abfb0c2f-b1b0-4573-aaab-5a1889e903f4 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:30.130121 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-fdf7a930-37f7-4fde-b92c-3e2d92c2d0cb tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:30.131058 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-fdf7a930-37f7-4fde-b92c-3e2d92c2d0cb tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:30.131759 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-fdf7a930-37f7-4fde-b92c-3e2d92c2d0cb tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:30.138497 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-abfb0c2f-b1b0-4573-aaab-5a1889e903f4 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4" status: 200 len: 1321 microversion: 2.1 time: 0.164463 Jun 07 09:29:30.150200 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 116/231] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:29 2022] GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4 => generated 1321 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:30.350098 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-fdf7a930-37f7-4fde-b92c-3e2d92c2d0cb tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:30.357496 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-fdf7a930-37f7-4fde-b92c-3e2d92c2d0cb tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd" status: 200 len: 1366 microversion: 2.1 time: 0.241482 Jun 07 09:29:30.358060 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 116/232] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:30 2022] GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd => generated 1366 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:29:30.699105 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-10adb8fe-53d6-4a42-b742-01ecbc980847 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:30.699105 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-10adb8fe-53d6-4a42-b742-01ecbc980847 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:30.703447 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-10adb8fe-53d6-4a42-b742-01ecbc980847 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:30.704251 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-10adb8fe-53d6-4a42-b742-01ecbc980847 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:30.705266 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-10adb8fe-53d6-4a42-b742-01ecbc980847 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:30.705884 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-10adb8fe-53d6-4a42-b742-01ecbc980847 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:30.845517 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-10adb8fe-53d6-4a42-b742-01ecbc980847 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:30.853363 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-10adb8fe-53d6-4a42-b742-01ecbc980847 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:30.854862 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-10adb8fe-53d6-4a42-b742-01ecbc980847 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:30.855967 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-10adb8fe-53d6-4a42-b742-01ecbc980847 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1405 microversion: 2.20 time: 0.164638 Jun 07 09:29:30.857266 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 117/233] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:29:30 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1405 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:29:30.875566 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-19b21f77-e0a5-4b7b-a966-8a70265f1524 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:30.876252 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-19b21f77-e0a5-4b7b-a966-8a70265f1524 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:30.884677 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-19b21f77-e0a5-4b7b-a966-8a70265f1524 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:30.885422 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-19b21f77-e0a5-4b7b-a966-8a70265f1524 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:30.886623 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-19b21f77-e0a5-4b7b-a966-8a70265f1524 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:30.887273 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-19b21f77-e0a5-4b7b-a966-8a70265f1524 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:31.054512 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-19b21f77-e0a5-4b7b-a966-8a70265f1524 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0346f4e3855142059983083e71c2c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c21b1cbbd604d6d9c97ab7c3c788f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:31.062874 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-19b21f77-e0a5-4b7b-a966-8a70265f1524 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25" status: 200 len: 1362 microversion: 2.1 time: 0.191453 Jun 07 09:29:31.063489 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 117/234] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:30 2022] GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 => generated 1362 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:31.159590 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-7605aa96-3b42-4e2a-b87b-a98d28a28cd1 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:31.160882 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-7605aa96-3b42-4e2a-b87b-a98d28a28cd1 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:31.166912 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-7605aa96-3b42-4e2a-b87b-a98d28a28cd1 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:31.167728 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-7605aa96-3b42-4e2a-b87b-a98d28a28cd1 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:31.168532 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-7605aa96-3b42-4e2a-b87b-a98d28a28cd1 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:31.169181 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-7605aa96-3b42-4e2a-b87b-a98d28a28cd1 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:31.298238 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [req-ec48ec1b-1b36-44fb-8e85-495b233ff912 req-219a5371-2c2d-4a05-921c-7b99789ed8c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e41026b-9a96-47df-a158-d8ea485025bd", "name": "network-vif-plugged", "status": "completed", "tag": "0f719a33-a29f-4d0f-8c3c-af19fd8fe82d"}]} {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:29:31.308352 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [req-ec48ec1b-1b36-44fb-8e85-495b233ff912 req-219a5371-2c2d-4a05-921c-7b99789ed8c0 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:31.310231 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [req-ec48ec1b-1b36-44fb-8e85-495b233ff912 req-219a5371-2c2d-4a05-921c-7b99789ed8c0 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:31.323119 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.compute.server_external_events [req-ec48ec1b-1b36-44fb-8e85-495b233ff912 req-219a5371-2c2d-4a05-921c-7b99789ed8c0 service nova] Creating event network-vif-plugged:0f719a33-a29f-4d0f-8c3c-af19fd8fe82d for instance 0e41026b-9a96-47df-a158-d8ea485025bd on hv-cinder-83699 Jun 07 09:29:31.331242 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [req-ec48ec1b-1b36-44fb-8e85-495b233ff912 req-219a5371-2c2d-4a05-921c-7b99789ed8c0 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037128 Jun 07 09:29:31.331883 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 118/235] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Jun 7 09:29:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:29:31.354548 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-7605aa96-3b42-4e2a-b87b-a98d28a28cd1 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:31.362769 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-7605aa96-3b42-4e2a-b87b-a98d28a28cd1 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4" status: 200 len: 1321 microversion: 2.1 time: 0.208207 Jun 07 09:29:31.363334 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 118/236] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:31 2022] GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4 => generated 1321 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:31.375563 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-520bb091-ae3c-457d-a8c7-ac65eff15f61 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:31.376291 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-520bb091-ae3c-457d-a8c7-ac65eff15f61 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 0e41026b-9a96-47df-a158-d8ea485025bd] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:31.382657 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-520bb091-ae3c-457d-a8c7-ac65eff15f61 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:31.383085 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-520bb091-ae3c-457d-a8c7-ac65eff15f61 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:31.383888 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-520bb091-ae3c-457d-a8c7-ac65eff15f61 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:31.384324 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-520bb091-ae3c-457d-a8c7-ac65eff15f61 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:31.524678 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-520bb091-ae3c-457d-a8c7-ac65eff15f61 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:31.532624 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-520bb091-ae3c-457d-a8c7-ac65eff15f61 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd" status: 200 len: 1366 microversion: 2.1 time: 0.161709 Jun 07 09:29:31.533201 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 119/237] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:31 2022] GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:31.878982 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-5e52fd1a-8710-4f11-b2a5-f5dfff376e3b tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:31.879590 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-5e52fd1a-8710-4f11-b2a5-f5dfff376e3b tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:31.886124 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-5e52fd1a-8710-4f11-b2a5-f5dfff376e3b tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:31.886567 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-5e52fd1a-8710-4f11-b2a5-f5dfff376e3b tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:31.887327 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-5e52fd1a-8710-4f11-b2a5-f5dfff376e3b tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:31.887760 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-5e52fd1a-8710-4f11-b2a5-f5dfff376e3b tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:32.022640 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-5e52fd1a-8710-4f11-b2a5-f5dfff376e3b tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:32.031155 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-5e52fd1a-8710-4f11-b2a5-f5dfff376e3b tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:32.032673 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-5e52fd1a-8710-4f11-b2a5-f5dfff376e3b tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:32.033763 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-5e52fd1a-8710-4f11-b2a5-f5dfff376e3b tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1405 microversion: 2.20 time: 0.158753 Jun 07 09:29:32.043104 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 119/238] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:29:31 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1405 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:29:32.079744 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-22b918ad-a486-46b2-a115-cdd76b031455 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:32.080378 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-22b918ad-a486-46b2-a115-cdd76b031455 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:32.086368 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-22b918ad-a486-46b2-a115-cdd76b031455 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:32.086809 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-22b918ad-a486-46b2-a115-cdd76b031455 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:32.087557 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-22b918ad-a486-46b2-a115-cdd76b031455 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:32.088056 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-22b918ad-a486-46b2-a115-cdd76b031455 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:32.103395 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writing DB stats nova_cell1:SELECT=100 {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:29:32.214522 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-22b918ad-a486-46b2-a115-cdd76b031455 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0346f4e3855142059983083e71c2c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c21b1cbbd604d6d9c97ab7c3c788f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:32.222487 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-22b918ad-a486-46b2-a115-cdd76b031455 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25" status: 200 len: 1362 microversion: 2.1 time: 0.146595 Jun 07 09:29:32.223085 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 120/239] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:32 2022] GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:32.381968 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-59a885cf-f3ad-433a-8a86-e0b9892f4c29 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:32.382765 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-59a885cf-f3ad-433a-8a86-e0b9892f4c29 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:32.389320 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-59a885cf-f3ad-433a-8a86-e0b9892f4c29 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:32.389778 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-59a885cf-f3ad-433a-8a86-e0b9892f4c29 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:32.390567 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-59a885cf-f3ad-433a-8a86-e0b9892f4c29 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:32.391008 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-59a885cf-f3ad-433a-8a86-e0b9892f4c29 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:32.549981 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-6915ec9b-1c3e-4c18-a339-a774fa285492 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:32.551170 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-6915ec9b-1c3e-4c18-a339-a774fa285492 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 0e41026b-9a96-47df-a158-d8ea485025bd] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:32.554732 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-59a885cf-f3ad-433a-8a86-e0b9892f4c29 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:32.557321 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-6915ec9b-1c3e-4c18-a339-a774fa285492 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:32.557775 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-6915ec9b-1c3e-4c18-a339-a774fa285492 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:32.558541 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-6915ec9b-1c3e-4c18-a339-a774fa285492 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:32.558982 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-6915ec9b-1c3e-4c18-a339-a774fa285492 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:32.564768 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-59a885cf-f3ad-433a-8a86-e0b9892f4c29 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4" status: 200 len: 1321 microversion: 2.1 time: 0.186479 Jun 07 09:29:32.565473 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 120/240] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:32 2022] GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4 => generated 1321 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:32.694159 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-6915ec9b-1c3e-4c18-a339-a774fa285492 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:32.702645 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-6915ec9b-1c3e-4c18-a339-a774fa285492 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd" status: 200 len: 1366 microversion: 2.1 time: 0.156508 Jun 07 09:29:32.703222 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 121/241] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:32 2022] GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:29:33.052304 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-aafddee9-7b7d-4bf3-b53f-f477a47b06a5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:33.053061 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-aafddee9-7b7d-4bf3-b53f-f477a47b06a5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:33.059300 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-aafddee9-7b7d-4bf3-b53f-f477a47b06a5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:33.059753 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-aafddee9-7b7d-4bf3-b53f-f477a47b06a5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:33.060514 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-aafddee9-7b7d-4bf3-b53f-f477a47b06a5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:33.060978 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-aafddee9-7b7d-4bf3-b53f-f477a47b06a5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:33.192367 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-aafddee9-7b7d-4bf3-b53f-f477a47b06a5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:33.200842 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-aafddee9-7b7d-4bf3-b53f-f477a47b06a5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:33.202364 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-aafddee9-7b7d-4bf3-b53f-f477a47b06a5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:33.203499 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-aafddee9-7b7d-4bf3-b53f-f477a47b06a5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1405 microversion: 2.20 time: 0.155004 Jun 07 09:29:33.204063 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 121/242] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:29:33 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1405 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:29:33.239414 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-b8cf6dc4-eb87-4d03-b78e-ea62c15db4a9 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:33.240014 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-b8cf6dc4-eb87-4d03-b78e-ea62c15db4a9 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:33.246042 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b8cf6dc4-eb87-4d03-b78e-ea62c15db4a9 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:33.246490 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b8cf6dc4-eb87-4d03-b78e-ea62c15db4a9 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:33.247429 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b8cf6dc4-eb87-4d03-b78e-ea62c15db4a9 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:33.247868 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b8cf6dc4-eb87-4d03-b78e-ea62c15db4a9 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:33.378837 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-b8cf6dc4-eb87-4d03-b78e-ea62c15db4a9 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0346f4e3855142059983083e71c2c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c21b1cbbd604d6d9c97ab7c3c788f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:33.386293 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-b8cf6dc4-eb87-4d03-b78e-ea62c15db4a9 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25" status: 200 len: 1362 microversion: 2.1 time: 0.150727 Jun 07 09:29:33.386860 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 122/243] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:33 2022] GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:33.581667 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-d57d8a0f-9fc3-48e9-9f49-4f55299c440e tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:33.582312 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-d57d8a0f-9fc3-48e9-9f49-4f55299c440e tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:33.588297 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-d57d8a0f-9fc3-48e9-9f49-4f55299c440e tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:33.588784 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-d57d8a0f-9fc3-48e9-9f49-4f55299c440e tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:33.591541 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-d57d8a0f-9fc3-48e9-9f49-4f55299c440e tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:33.591541 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-d57d8a0f-9fc3-48e9-9f49-4f55299c440e tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:33.722445 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-44bf7934-f916-43f7-a3d6-28b0b4cae241 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:33.722445 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-44bf7934-f916-43f7-a3d6-28b0b4cae241 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 0e41026b-9a96-47df-a158-d8ea485025bd] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:33.722965 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-d57d8a0f-9fc3-48e9-9f49-4f55299c440e tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:33.726608 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-44bf7934-f916-43f7-a3d6-28b0b4cae241 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:33.727055 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-44bf7934-f916-43f7-a3d6-28b0b4cae241 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:33.727823 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-44bf7934-f916-43f7-a3d6-28b0b4cae241 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:33.728256 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-44bf7934-f916-43f7-a3d6-28b0b4cae241 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:33.729410 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-d57d8a0f-9fc3-48e9-9f49-4f55299c440e tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4" status: 200 len: 1321 microversion: 2.1 time: 0.151721 Jun 07 09:29:33.729961 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 122/244] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:33 2022] GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4 => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:33.896280 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-44bf7934-f916-43f7-a3d6-28b0b4cae241 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:33.904312 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-44bf7934-f916-43f7-a3d6-28b0b4cae241 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd" status: 200 len: 1366 microversion: 2.1 time: 0.188830 Jun 07 09:29:33.905020 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 123/245] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:33 2022] GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd => generated 1366 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:34.221429 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-30888e36-fb2c-4d89-a916-027bde559b86 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:34.222085 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-30888e36-fb2c-4d89-a916-027bde559b86 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:34.228813 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-30888e36-fb2c-4d89-a916-027bde559b86 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:34.229260 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-30888e36-fb2c-4d89-a916-027bde559b86 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:34.230056 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-30888e36-fb2c-4d89-a916-027bde559b86 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:34.230489 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-30888e36-fb2c-4d89-a916-027bde559b86 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:34.357598 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-30888e36-fb2c-4d89-a916-027bde559b86 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:34.365647 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-30888e36-fb2c-4d89-a916-027bde559b86 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:34.367145 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-30888e36-fb2c-4d89-a916-027bde559b86 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:34.368245 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-30888e36-fb2c-4d89-a916-027bde559b86 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1405 microversion: 2.20 time: 0.150808 Jun 07 09:29:34.368837 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 123/246] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:29:34 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1405 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:29:34.403636 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-d9822e78-be46-4870-ad1f-2695dd643091 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:34.404249 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-d9822e78-be46-4870-ad1f-2695dd643091 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:34.410404 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-d9822e78-be46-4870-ad1f-2695dd643091 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:34.410858 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-d9822e78-be46-4870-ad1f-2695dd643091 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:34.411621 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-d9822e78-be46-4870-ad1f-2695dd643091 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:34.412060 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-d9822e78-be46-4870-ad1f-2695dd643091 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:34.544615 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-d9822e78-be46-4870-ad1f-2695dd643091 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0346f4e3855142059983083e71c2c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c21b1cbbd604d6d9c97ab7c3c788f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:34.553024 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-d9822e78-be46-4870-ad1f-2695dd643091 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25" status: 200 len: 1362 microversion: 2.1 time: 0.153832 Jun 07 09:29:34.553592 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 124/247] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:34 2022] GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:29:34.746768 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-759d5d60-8673-431e-995d-bcd00fb6a566 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:34.747375 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-759d5d60-8673-431e-995d-bcd00fb6a566 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:34.753209 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-759d5d60-8673-431e-995d-bcd00fb6a566 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:34.753656 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-759d5d60-8673-431e-995d-bcd00fb6a566 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:34.754427 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-759d5d60-8673-431e-995d-bcd00fb6a566 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:34.754856 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-759d5d60-8673-431e-995d-bcd00fb6a566 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:34.887152 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-759d5d60-8673-431e-995d-bcd00fb6a566 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:34.895227 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-759d5d60-8673-431e-995d-bcd00fb6a566 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4" status: 200 len: 1321 microversion: 2.1 time: 0.152312 Jun 07 09:29:34.895793 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 124/248] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:34 2022] GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4 => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:34.920428 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-10ab6c96-7877-4d83-b551-c20b870c3205 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:34.921071 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-10ab6c96-7877-4d83-b551-c20b870c3205 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 0e41026b-9a96-47df-a158-d8ea485025bd] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:34.922900 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writing DB stats nova_api:SELECT=100 {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:29:34.927621 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-10ab6c96-7877-4d83-b551-c20b870c3205 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:34.928072 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-10ab6c96-7877-4d83-b551-c20b870c3205 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:34.928889 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-10ab6c96-7877-4d83-b551-c20b870c3205 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:34.929362 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-10ab6c96-7877-4d83-b551-c20b870c3205 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:35.062395 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-10ab6c96-7877-4d83-b551-c20b870c3205 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:35.070032 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-10ab6c96-7877-4d83-b551-c20b870c3205 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd" status: 200 len: 1366 microversion: 2.1 time: 0.153535 Jun 07 09:29:35.070618 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 125/249] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:34 2022] GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:35.386353 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-62137018-d916-44ec-b839-ca62fb738643 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:35.386962 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-62137018-d916-44ec-b839-ca62fb738643 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:35.394640 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-62137018-d916-44ec-b839-ca62fb738643 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:35.395096 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-62137018-d916-44ec-b839-ca62fb738643 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:35.395870 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-62137018-d916-44ec-b839-ca62fb738643 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:35.396309 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-62137018-d916-44ec-b839-ca62fb738643 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:35.526107 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-62137018-d916-44ec-b839-ca62fb738643 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:35.534088 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-62137018-d916-44ec-b839-ca62fb738643 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:35.535754 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-62137018-d916-44ec-b839-ca62fb738643 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:35.537191 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-62137018-d916-44ec-b839-ca62fb738643 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1405 microversion: 2.20 time: 0.154801 Jun 07 09:29:35.537881 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 125/250] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:29:35 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1405 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:29:35.569510 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-154baa78-cae9-4e96-8125-cdaaabd52d90 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:35.570135 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-154baa78-cae9-4e96-8125-cdaaabd52d90 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:35.576173 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-154baa78-cae9-4e96-8125-cdaaabd52d90 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:35.576678 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-154baa78-cae9-4e96-8125-cdaaabd52d90 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:35.577460 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-154baa78-cae9-4e96-8125-cdaaabd52d90 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:35.577889 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-154baa78-cae9-4e96-8125-cdaaabd52d90 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:35.710055 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-154baa78-cae9-4e96-8125-cdaaabd52d90 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0346f4e3855142059983083e71c2c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c21b1cbbd604d6d9c97ab7c3c788f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:35.717725 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-154baa78-cae9-4e96-8125-cdaaabd52d90 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25" status: 200 len: 1362 microversion: 2.1 time: 0.151984 Jun 07 09:29:35.718305 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 126/251] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:35 2022] GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:35.912127 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-e45ff7d1-74c0-407c-8c65-4e63af685066 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:35.912860 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-e45ff7d1-74c0-407c-8c65-4e63af685066 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:35.919455 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-e45ff7d1-74c0-407c-8c65-4e63af685066 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:35.919899 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-e45ff7d1-74c0-407c-8c65-4e63af685066 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:35.920692 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-e45ff7d1-74c0-407c-8c65-4e63af685066 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:35.921127 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-e45ff7d1-74c0-407c-8c65-4e63af685066 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:36.050876 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-e45ff7d1-74c0-407c-8c65-4e63af685066 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:36.058509 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-e45ff7d1-74c0-407c-8c65-4e63af685066 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4" status: 200 len: 1321 microversion: 2.1 time: 0.150069 Jun 07 09:29:36.060200 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 126/252] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:35 2022] GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4 => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:36.087470 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-a8c0cd10-b79c-4c9a-ab05-37c76c10cebc tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:36.088091 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-a8c0cd10-b79c-4c9a-ab05-37c76c10cebc tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 0e41026b-9a96-47df-a158-d8ea485025bd] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:36.095031 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-a8c0cd10-b79c-4c9a-ab05-37c76c10cebc tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:36.097612 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-a8c0cd10-b79c-4c9a-ab05-37c76c10cebc tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:36.097612 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-a8c0cd10-b79c-4c9a-ab05-37c76c10cebc tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:36.097612 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-a8c0cd10-b79c-4c9a-ab05-37c76c10cebc tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:36.243501 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-a8c0cd10-b79c-4c9a-ab05-37c76c10cebc tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:36.251831 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-a8c0cd10-b79c-4c9a-ab05-37c76c10cebc tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd" status: 200 len: 1366 microversion: 2.1 time: 0.168089 Jun 07 09:29:36.252499 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 127/253] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:36 2022] GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:29:36.555790 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-1cf6c1ac-4d0e-48d8-a931-583c7ca06905 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:36.556476 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-1cf6c1ac-4d0e-48d8-a931-583c7ca06905 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:36.563036 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-1cf6c1ac-4d0e-48d8-a931-583c7ca06905 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:36.563591 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-1cf6c1ac-4d0e-48d8-a931-583c7ca06905 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:36.564417 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-1cf6c1ac-4d0e-48d8-a931-583c7ca06905 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:36.564882 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-1cf6c1ac-4d0e-48d8-a931-583c7ca06905 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:36.697887 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-1cf6c1ac-4d0e-48d8-a931-583c7ca06905 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:36.705861 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-1cf6c1ac-4d0e-48d8-a931-583c7ca06905 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:36.707618 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-1cf6c1ac-4d0e-48d8-a931-583c7ca06905 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:36.708756 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-1cf6c1ac-4d0e-48d8-a931-583c7ca06905 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1405 microversion: 2.20 time: 0.156788 Jun 07 09:29:36.709338 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 127/254] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:29:36 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1405 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:29:36.735392 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-f3099bfd-e78d-4578-a7dd-447b28397039 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:36.735994 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-f3099bfd-e78d-4578-a7dd-447b28397039 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:36.742064 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-f3099bfd-e78d-4578-a7dd-447b28397039 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:36.742505 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-f3099bfd-e78d-4578-a7dd-447b28397039 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:36.743252 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-f3099bfd-e78d-4578-a7dd-447b28397039 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:36.743677 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-f3099bfd-e78d-4578-a7dd-447b28397039 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:36.880881 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-f3099bfd-e78d-4578-a7dd-447b28397039 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0346f4e3855142059983083e71c2c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c21b1cbbd604d6d9c97ab7c3c788f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:36.888978 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-f3099bfd-e78d-4578-a7dd-447b28397039 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25" status: 200 len: 1362 microversion: 2.1 time: 0.158295 Jun 07 09:29:36.889546 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 128/255] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:36 2022] GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:37.075475 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-dfc07b61-953d-4884-8157-87c56b408591 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:37.076107 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-dfc07b61-953d-4884-8157-87c56b408591 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:37.082117 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-dfc07b61-953d-4884-8157-87c56b408591 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:37.082558 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-dfc07b61-953d-4884-8157-87c56b408591 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:37.083308 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-dfc07b61-953d-4884-8157-87c56b408591 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:37.083733 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-dfc07b61-953d-4884-8157-87c56b408591 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:37.209992 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-dfc07b61-953d-4884-8157-87c56b408591 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:37.218122 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-dfc07b61-953d-4884-8157-87c56b408591 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4" status: 200 len: 1321 microversion: 2.1 time: 0.147084 Jun 07 09:29:37.218681 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 128/256] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:37 2022] GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4 => generated 1321 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:37.269235 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-d9f9fe2e-724f-4733-99a3-a1387d98c8c1 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:37.270431 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-d9f9fe2e-724f-4733-99a3-a1387d98c8c1 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 0e41026b-9a96-47df-a158-d8ea485025bd] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:37.276398 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-d9f9fe2e-724f-4733-99a3-a1387d98c8c1 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:37.277063 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-d9f9fe2e-724f-4733-99a3-a1387d98c8c1 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:37.278063 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-d9f9fe2e-724f-4733-99a3-a1387d98c8c1 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:37.278644 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-d9f9fe2e-724f-4733-99a3-a1387d98c8c1 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:37.431069 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-d9f9fe2e-724f-4733-99a3-a1387d98c8c1 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:37.439389 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-d9f9fe2e-724f-4733-99a3-a1387d98c8c1 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd" status: 200 len: 1366 microversion: 2.1 time: 0.173938 Jun 07 09:29:37.440042 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 129/257] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:37 2022] GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:37.727808 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-40ad29a3-7613-4e44-8ff6-270ed24f3fd2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:37.728774 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-40ad29a3-7613-4e44-8ff6-270ed24f3fd2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:37.738573 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-40ad29a3-7613-4e44-8ff6-270ed24f3fd2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:37.739186 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-40ad29a3-7613-4e44-8ff6-270ed24f3fd2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:37.740281 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-40ad29a3-7613-4e44-8ff6-270ed24f3fd2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:37.740944 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-40ad29a3-7613-4e44-8ff6-270ed24f3fd2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:37.897744 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-40ad29a3-7613-4e44-8ff6-270ed24f3fd2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:37.906350 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-40ad29a3-7613-4e44-8ff6-270ed24f3fd2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:37.907296 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-eeda99b2-2d40-44cf-9bb0-bafcff2961f4 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:37.907892 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-40ad29a3-7613-4e44-8ff6-270ed24f3fd2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:37.908003 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-eeda99b2-2d40-44cf-9bb0-bafcff2961f4 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:37.909031 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-40ad29a3-7613-4e44-8ff6-270ed24f3fd2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1405 microversion: 2.20 time: 0.185746 Jun 07 09:29:37.909786 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 129/258] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:29:37 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1405 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:29:37.914057 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-eeda99b2-2d40-44cf-9bb0-bafcff2961f4 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:37.914496 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-eeda99b2-2d40-44cf-9bb0-bafcff2961f4 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:37.915241 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-eeda99b2-2d40-44cf-9bb0-bafcff2961f4 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:37.915665 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-eeda99b2-2d40-44cf-9bb0-bafcff2961f4 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:38.061776 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-eeda99b2-2d40-44cf-9bb0-bafcff2961f4 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0346f4e3855142059983083e71c2c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c21b1cbbd604d6d9c97ab7c3c788f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:38.069314 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-eeda99b2-2d40-44cf-9bb0-bafcff2961f4 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25" status: 200 len: 1362 microversion: 2.1 time: 0.167443 Jun 07 09:29:38.069946 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 130/259] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:37 2022] GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:29:38.236146 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-15d450b2-d5b3-40ae-a1d2-c72a2f90d0a0 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:38.237458 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-15d450b2-d5b3-40ae-a1d2-c72a2f90d0a0 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:38.243404 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-15d450b2-d5b3-40ae-a1d2-c72a2f90d0a0 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:38.243999 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-15d450b2-d5b3-40ae-a1d2-c72a2f90d0a0 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:38.244811 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-15d450b2-d5b3-40ae-a1d2-c72a2f90d0a0 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:38.245418 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-15d450b2-d5b3-40ae-a1d2-c72a2f90d0a0 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:38.391329 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-15d450b2-d5b3-40ae-a1d2-c72a2f90d0a0 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:38.399631 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-15d450b2-d5b3-40ae-a1d2-c72a2f90d0a0 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4" status: 200 len: 1321 microversion: 2.1 time: 0.168887 Jun 07 09:29:38.400200 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 130/260] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:38 2022] GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4 => generated 1321 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:38.456810 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-b82065c2-df9c-4453-9c57-d82f8435b247 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:38.457631 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-b82065c2-df9c-4453-9c57-d82f8435b247 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 0e41026b-9a96-47df-a158-d8ea485025bd] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:38.464094 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b82065c2-df9c-4453-9c57-d82f8435b247 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:38.464567 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b82065c2-df9c-4453-9c57-d82f8435b247 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:38.466023 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b82065c2-df9c-4453-9c57-d82f8435b247 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:38.466627 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b82065c2-df9c-4453-9c57-d82f8435b247 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:38.595155 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-b82065c2-df9c-4453-9c57-d82f8435b247 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:38.602609 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-b82065c2-df9c-4453-9c57-d82f8435b247 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd" status: 200 len: 1366 microversion: 2.1 time: 0.149789 Jun 07 09:29:38.603190 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 131/261] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:38 2022] GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:38.927571 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-d4793fed-3bec-4774-a1d3-46410bc884dd tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:38.928189 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-d4793fed-3bec-4774-a1d3-46410bc884dd tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:38.930619 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writing DB stats nova_api:SELECT=100 {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:29:38.935541 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-d4793fed-3bec-4774-a1d3-46410bc884dd tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:38.936009 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-d4793fed-3bec-4774-a1d3-46410bc884dd tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:38.936800 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-d4793fed-3bec-4774-a1d3-46410bc884dd tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:38.937234 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-d4793fed-3bec-4774-a1d3-46410bc884dd tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:38.942445 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writing DB stats nova_cell1:SELECT=100 {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:29:39.085759 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-45aa4f2b-1f00-49a3-ba49-7ce75eb60efe tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:39.086370 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-45aa4f2b-1f00-49a3-ba49-7ce75eb60efe tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:39.093438 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-45aa4f2b-1f00-49a3-ba49-7ce75eb60efe tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:39.093890 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-45aa4f2b-1f00-49a3-ba49-7ce75eb60efe tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:39.094652 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-45aa4f2b-1f00-49a3-ba49-7ce75eb60efe tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:39.095260 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-45aa4f2b-1f00-49a3-ba49-7ce75eb60efe tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:39.117593 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-d4793fed-3bec-4774-a1d3-46410bc884dd tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:39.127879 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-d4793fed-3bec-4774-a1d3-46410bc884dd tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:39.129638 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-d4793fed-3bec-4774-a1d3-46410bc884dd tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:39.138105 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-d4793fed-3bec-4774-a1d3-46410bc884dd tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1405 microversion: 2.20 time: 0.207201 Jun 07 09:29:39.138105 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 131/262] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:29:38 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1405 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 09:29:39.237099 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-45aa4f2b-1f00-49a3-ba49-7ce75eb60efe tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0346f4e3855142059983083e71c2c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c21b1cbbd604d6d9c97ab7c3c788f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:39.260782 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-45aa4f2b-1f00-49a3-ba49-7ce75eb60efe tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25" status: 200 len: 1548 microversion: 2.1 time: 0.179068 Jun 07 09:29:39.265013 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 132/263] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:39 2022] GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 => generated 1548 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:39.282791 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-324e043f-ffbf-436c-b6e1-a55d1329bb2a tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:39.283395 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-324e043f-ffbf-436c-b6e1-a55d1329bb2a tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:39.300955 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-324e043f-ffbf-436c-b6e1-a55d1329bb2a tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:39.300955 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-324e043f-ffbf-436c-b6e1-a55d1329bb2a tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:39.300955 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-324e043f-ffbf-436c-b6e1-a55d1329bb2a tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:39.300955 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-324e043f-ffbf-436c-b6e1-a55d1329bb2a tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:39.370546 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-324e043f-ffbf-436c-b6e1-a55d1329bb2a tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092465 Jun 07 09:29:39.371204 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 132/264] 10.222.0.57 () {58 vars in 1274 bytes} [Tue Jun 7 09:29:39 2022] GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:29:39.416714 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-135ceb55-dcde-48ed-b599-7f9eccb984d6 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:39.417328 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-135ceb55-dcde-48ed-b599-7f9eccb984d6 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:39.425303 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-135ceb55-dcde-48ed-b599-7f9eccb984d6 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:39.426586 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-135ceb55-dcde-48ed-b599-7f9eccb984d6 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:39.429595 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-135ceb55-dcde-48ed-b599-7f9eccb984d6 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:39.430224 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-135ceb55-dcde-48ed-b599-7f9eccb984d6 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:39.619806 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-3fdda017-a97b-481e-bfe5-949006a5aa0c tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:39.620467 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-3fdda017-a97b-481e-bfe5-949006a5aa0c tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 0e41026b-9a96-47df-a158-d8ea485025bd] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:39.621487 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-135ceb55-dcde-48ed-b599-7f9eccb984d6 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:39.629430 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-3fdda017-a97b-481e-bfe5-949006a5aa0c tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:39.629861 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-135ceb55-dcde-48ed-b599-7f9eccb984d6 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4" status: 200 len: 1321 microversion: 2.1 time: 0.217027 Jun 07 09:29:39.630270 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-3fdda017-a97b-481e-bfe5-949006a5aa0c tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:39.631699 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-3fdda017-a97b-481e-bfe5-949006a5aa0c tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:39.632380 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-3fdda017-a97b-481e-bfe5-949006a5aa0c tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:39.638945 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 133/265] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:39 2022] GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4 => generated 1321 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:39.843298 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [req-9e4a8ca4-2ee2-45e0-a15f-265121cfc77e req-0808bf78-0fbc-4983-992b-23977ddc8835 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4", "name": "network-vif-plugged", "status": "completed", "tag": "ef58ec65-d688-494a-a9db-c6f18cac46a0"}]} {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:29:39.853483 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [req-9e4a8ca4-2ee2-45e0-a15f-265121cfc77e req-0808bf78-0fbc-4983-992b-23977ddc8835 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:39.854530 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [req-9e4a8ca4-2ee2-45e0-a15f-265121cfc77e req-0808bf78-0fbc-4983-992b-23977ddc8835 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:39.869285 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.compute.server_external_events [req-9e4a8ca4-2ee2-45e0-a15f-265121cfc77e req-0808bf78-0fbc-4983-992b-23977ddc8835 service nova] Creating event network-vif-plugged:ef58ec65-d688-494a-a9db-c6f18cac46a0 for instance a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4 on hv-cinder-83699 Jun 07 09:29:39.877789 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [req-9e4a8ca4-2ee2-45e0-a15f-265121cfc77e req-0808bf78-0fbc-4983-992b-23977ddc8835 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039901 Jun 07 09:29:39.877789 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 134/266] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Jun 7 09:29:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 09:29:39.984421 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-3fdda017-a97b-481e-bfe5-949006a5aa0c tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:39.991791 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-3fdda017-a97b-481e-bfe5-949006a5aa0c tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd" status: 200 len: 1366 microversion: 2.1 time: 0.376319 Jun 07 09:29:39.992383 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 133/267] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:39 2022] GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd => generated 1366 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:29:40.151490 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-34f89ae1-5690-4aee-8f99-ae063a3db903 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:40.152237 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-34f89ae1-5690-4aee-8f99-ae063a3db903 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:40.159420 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-34f89ae1-5690-4aee-8f99-ae063a3db903 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:40.159866 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-34f89ae1-5690-4aee-8f99-ae063a3db903 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:40.160681 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-34f89ae1-5690-4aee-8f99-ae063a3db903 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:40.161115 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-34f89ae1-5690-4aee-8f99-ae063a3db903 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:40.324476 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-34f89ae1-5690-4aee-8f99-ae063a3db903 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:40.337172 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-34f89ae1-5690-4aee-8f99-ae063a3db903 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:40.338928 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-34f89ae1-5690-4aee-8f99-ae063a3db903 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:40.340767 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-34f89ae1-5690-4aee-8f99-ae063a3db903 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1405 microversion: 2.20 time: 0.193327 Jun 07 09:29:40.341773 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 135/268] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:29:40 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1405 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:29:40.646378 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-707a1645-4789-4617-8e4e-2ac31c55dcff tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:40.647922 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-707a1645-4789-4617-8e4e-2ac31c55dcff tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:40.656470 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-707a1645-4789-4617-8e4e-2ac31c55dcff tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:40.657257 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-707a1645-4789-4617-8e4e-2ac31c55dcff tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:40.658114 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-707a1645-4789-4617-8e4e-2ac31c55dcff tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:40.658623 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-707a1645-4789-4617-8e4e-2ac31c55dcff tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:40.839743 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-707a1645-4789-4617-8e4e-2ac31c55dcff tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:40.847861 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-707a1645-4789-4617-8e4e-2ac31c55dcff tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4" status: 200 len: 1321 microversion: 2.1 time: 0.205535 Jun 07 09:29:40.848448 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 134/269] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:40 2022] GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4 => generated 1321 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:40.976283 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [req-8c16307f-f19a-495f-a3dd-d9452a3e701d req-9f466035-59e8-4851-9c35-ea7bbe62c07e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25", "tag": "0d872428-4ab3-4d4f-845c-f8715f978155"}]} {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:29:40.985054 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [req-8c16307f-f19a-495f-a3dd-d9452a3e701d req-9f466035-59e8-4851-9c35-ea7bbe62c07e service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:40.985489 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [req-8c16307f-f19a-495f-a3dd-d9452a3e701d req-9f466035-59e8-4851-9c35-ea7bbe62c07e service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:40.996082 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.compute.server_external_events [req-8c16307f-f19a-495f-a3dd-d9452a3e701d req-9f466035-59e8-4851-9c35-ea7bbe62c07e service nova] Creating event network-changed:0d872428-4ab3-4d4f-845c-f8715f978155 for instance 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 on hv-cinder-83699 Jun 07 09:29:41.001489 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [req-8c16307f-f19a-495f-a3dd-d9452a3e701d req-9f466035-59e8-4851-9c35-ea7bbe62c07e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028830 Jun 07 09:29:41.002062 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 136/270] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Jun 7 09:29:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:29:41.010064 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-e0ffd19c-50c7-4d99-ae49-82c3ccdd2307 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:41.010672 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-e0ffd19c-50c7-4d99-ae49-82c3ccdd2307 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 0e41026b-9a96-47df-a158-d8ea485025bd] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:41.017423 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-e0ffd19c-50c7-4d99-ae49-82c3ccdd2307 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:41.017868 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-e0ffd19c-50c7-4d99-ae49-82c3ccdd2307 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:41.018624 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-e0ffd19c-50c7-4d99-ae49-82c3ccdd2307 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:41.019053 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-e0ffd19c-50c7-4d99-ae49-82c3ccdd2307 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:41.159000 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-e0ffd19c-50c7-4d99-ae49-82c3ccdd2307 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:41.166399 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-e0ffd19c-50c7-4d99-ae49-82c3ccdd2307 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd" status: 200 len: 1366 microversion: 2.1 time: 0.160105 Jun 07 09:29:41.166955 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 135/271] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:41 2022] GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:29:41.360625 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-5010a881-c694-4b4a-af96-e4e279bd5fea tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:41.361434 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-5010a881-c694-4b4a-af96-e4e279bd5fea tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:41.369547 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-5010a881-c694-4b4a-af96-e4e279bd5fea tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:41.370026 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-5010a881-c694-4b4a-af96-e4e279bd5fea tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:41.371272 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-5010a881-c694-4b4a-af96-e4e279bd5fea tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:41.372309 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-5010a881-c694-4b4a-af96-e4e279bd5fea tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:41.519667 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-5010a881-c694-4b4a-af96-e4e279bd5fea tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:41.528470 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-5010a881-c694-4b4a-af96-e4e279bd5fea tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:41.530440 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-5010a881-c694-4b4a-af96-e4e279bd5fea tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:41.531614 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-5010a881-c694-4b4a-af96-e4e279bd5fea tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1405 microversion: 2.20 time: 0.176152 Jun 07 09:29:41.532607 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 137/272] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:29:41 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1405 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:29:41.864980 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-577066e8-c346-4d09-b66a-29b66d56eb22 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:41.865694 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-577066e8-c346-4d09-b66a-29b66d56eb22 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:41.871894 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-577066e8-c346-4d09-b66a-29b66d56eb22 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:41.872421 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-577066e8-c346-4d09-b66a-29b66d56eb22 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:41.873278 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-577066e8-c346-4d09-b66a-29b66d56eb22 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:41.873810 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-577066e8-c346-4d09-b66a-29b66d56eb22 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:42.029013 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-577066e8-c346-4d09-b66a-29b66d56eb22 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:42.036961 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-577066e8-c346-4d09-b66a-29b66d56eb22 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4" status: 200 len: 1321 microversion: 2.1 time: 0.175650 Jun 07 09:29:42.037534 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 136/273] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:41 2022] GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4 => generated 1321 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:42.184898 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-3ac71397-164e-479e-ab64-e0de08c2c7db tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:42.185570 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-3ac71397-164e-479e-ab64-e0de08c2c7db tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 0e41026b-9a96-47df-a158-d8ea485025bd] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:42.191977 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-3ac71397-164e-479e-ab64-e0de08c2c7db tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:42.192429 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-3ac71397-164e-479e-ab64-e0de08c2c7db tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:42.193840 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-3ac71397-164e-479e-ab64-e0de08c2c7db tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:42.194287 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-3ac71397-164e-479e-ab64-e0de08c2c7db tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:42.210833 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writing DB stats nova_cell1:SELECT=100 {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:29:42.348366 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-3ac71397-164e-479e-ab64-e0de08c2c7db tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:42.360891 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-3ac71397-164e-479e-ab64-e0de08c2c7db tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd" status: 200 len: 1366 microversion: 2.1 time: 0.180905 Jun 07 09:29:42.362228 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 138/274] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:42 2022] GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd => generated 1366 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:42.550231 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-37d14f3c-6069-4b77-b8e0-a6e48c0bf3f5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:42.551077 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-37d14f3c-6069-4b77-b8e0-a6e48c0bf3f5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:42.557807 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-37d14f3c-6069-4b77-b8e0-a6e48c0bf3f5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:42.564322 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-37d14f3c-6069-4b77-b8e0-a6e48c0bf3f5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:42.564322 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-37d14f3c-6069-4b77-b8e0-a6e48c0bf3f5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:42.564322 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-37d14f3c-6069-4b77-b8e0-a6e48c0bf3f5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:42.702665 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-37d14f3c-6069-4b77-b8e0-a6e48c0bf3f5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:42.710445 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-37d14f3c-6069-4b77-b8e0-a6e48c0bf3f5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:42.712012 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-37d14f3c-6069-4b77-b8e0-a6e48c0bf3f5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:42.713050 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-37d14f3c-6069-4b77-b8e0-a6e48c0bf3f5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1405 microversion: 2.20 time: 0.167102 Jun 07 09:29:42.713597 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 137/275] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:29:42 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1405 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:29:43.054148 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-d796ab71-9481-48cd-ad46-8cbd7458cedc tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:43.054760 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-d796ab71-9481-48cd-ad46-8cbd7458cedc tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:43.060840 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-d796ab71-9481-48cd-ad46-8cbd7458cedc tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:43.061290 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-d796ab71-9481-48cd-ad46-8cbd7458cedc tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:43.062047 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-d796ab71-9481-48cd-ad46-8cbd7458cedc tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:43.062477 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-d796ab71-9481-48cd-ad46-8cbd7458cedc tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:43.196205 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-d796ab71-9481-48cd-ad46-8cbd7458cedc tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:43.203531 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-d796ab71-9481-48cd-ad46-8cbd7458cedc tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4" status: 200 len: 1321 microversion: 2.1 time: 0.153328 Jun 07 09:29:43.204087 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 139/276] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:43 2022] GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4 => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:43.379266 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-87db100e-b05e-4281-95b2-39439318c06b tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:43.379901 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-87db100e-b05e-4281-95b2-39439318c06b tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 0e41026b-9a96-47df-a158-d8ea485025bd] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:43.386439 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-87db100e-b05e-4281-95b2-39439318c06b tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:43.386888 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-87db100e-b05e-4281-95b2-39439318c06b tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:43.387647 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-87db100e-b05e-4281-95b2-39439318c06b tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:43.388118 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-87db100e-b05e-4281-95b2-39439318c06b tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:43.515975 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-87db100e-b05e-4281-95b2-39439318c06b tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:43.523690 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-87db100e-b05e-4281-95b2-39439318c06b tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd" status: 200 len: 1366 microversion: 2.1 time: 0.148405 Jun 07 09:29:43.524261 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 138/277] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:43 2022] GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:43.731220 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-55bcdb0d-7d25-4e89-9bad-af8aa2ad79bf tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:43.731834 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-55bcdb0d-7d25-4e89-9bad-af8aa2ad79bf tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:43.738415 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-55bcdb0d-7d25-4e89-9bad-af8aa2ad79bf tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:43.738889 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-55bcdb0d-7d25-4e89-9bad-af8aa2ad79bf tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:43.739712 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-55bcdb0d-7d25-4e89-9bad-af8aa2ad79bf tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:43.740148 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-55bcdb0d-7d25-4e89-9bad-af8aa2ad79bf tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:43.895473 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-55bcdb0d-7d25-4e89-9bad-af8aa2ad79bf tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:43.904144 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-55bcdb0d-7d25-4e89-9bad-af8aa2ad79bf tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:43.905696 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-55bcdb0d-7d25-4e89-9bad-af8aa2ad79bf tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:43.906837 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-55bcdb0d-7d25-4e89-9bad-af8aa2ad79bf tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1405 microversion: 2.20 time: 0.179594 Jun 07 09:29:43.907397 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 140/278] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:29:43 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1405 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:29:44.219680 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-dafec487-9c30-44a6-bf7c-c38dbc1e61be tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:44.220289 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-dafec487-9c30-44a6-bf7c-c38dbc1e61be tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:44.226308 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-dafec487-9c30-44a6-bf7c-c38dbc1e61be tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:44.226760 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-dafec487-9c30-44a6-bf7c-c38dbc1e61be tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:44.227525 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-dafec487-9c30-44a6-bf7c-c38dbc1e61be tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:44.227965 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-dafec487-9c30-44a6-bf7c-c38dbc1e61be tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:44.361902 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-dafec487-9c30-44a6-bf7c-c38dbc1e61be tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:44.374093 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-dafec487-9c30-44a6-bf7c-c38dbc1e61be tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4" status: 200 len: 1321 microversion: 2.1 time: 0.158662 Jun 07 09:29:44.375049 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 139/279] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:44 2022] GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4 => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:44.540537 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-eedf9e92-41df-4563-8589-61972f221e9c tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:44.542772 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-eedf9e92-41df-4563-8589-61972f221e9c tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 0e41026b-9a96-47df-a158-d8ea485025bd] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:44.547550 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-eedf9e92-41df-4563-8589-61972f221e9c tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:44.547987 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-eedf9e92-41df-4563-8589-61972f221e9c tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:44.548765 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-eedf9e92-41df-4563-8589-61972f221e9c tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:44.549190 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-eedf9e92-41df-4563-8589-61972f221e9c tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:44.676495 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-eedf9e92-41df-4563-8589-61972f221e9c tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:44.683816 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-eedf9e92-41df-4563-8589-61972f221e9c tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd" status: 200 len: 1366 microversion: 2.1 time: 0.147088 Jun 07 09:29:44.685016 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 141/280] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:44 2022] GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:44.924263 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-fda4a07c-9458-4bd6-830b-4a335320c8b8 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:44.926581 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-fda4a07c-9458-4bd6-830b-4a335320c8b8 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:44.931477 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-fda4a07c-9458-4bd6-830b-4a335320c8b8 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:44.932015 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-fda4a07c-9458-4bd6-830b-4a335320c8b8 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:44.932807 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-fda4a07c-9458-4bd6-830b-4a335320c8b8 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:44.933243 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-fda4a07c-9458-4bd6-830b-4a335320c8b8 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:45.064782 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-fda4a07c-9458-4bd6-830b-4a335320c8b8 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:45.072852 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-fda4a07c-9458-4bd6-830b-4a335320c8b8 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:45.074362 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-fda4a07c-9458-4bd6-830b-4a335320c8b8 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:45.075465 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-fda4a07c-9458-4bd6-830b-4a335320c8b8 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1405 microversion: 2.20 time: 0.155098 Jun 07 09:29:45.076046 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 140/281] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:29:44 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1405 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:29:45.391112 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-2bd41401-7612-4103-8bde-166e3aad1148 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:45.391719 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-2bd41401-7612-4103-8bde-166e3aad1148 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:45.397760 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-2bd41401-7612-4103-8bde-166e3aad1148 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:45.398207 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-2bd41401-7612-4103-8bde-166e3aad1148 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:45.398961 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-2bd41401-7612-4103-8bde-166e3aad1148 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:45.399391 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-2bd41401-7612-4103-8bde-166e3aad1148 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:45.531434 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-2bd41401-7612-4103-8bde-166e3aad1148 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:45.545888 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-2bd41401-7612-4103-8bde-166e3aad1148 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4" status: 200 len: 1321 microversion: 2.1 time: 0.158961 Jun 07 09:29:45.546831 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 142/282] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:45 2022] GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4 => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:45.703182 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-89158e2b-153b-4b35-adfe-27dd5b5ddaed tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:45.704132 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-89158e2b-153b-4b35-adfe-27dd5b5ddaed tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 0e41026b-9a96-47df-a158-d8ea485025bd] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:45.710537 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-89158e2b-153b-4b35-adfe-27dd5b5ddaed tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:45.711238 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-89158e2b-153b-4b35-adfe-27dd5b5ddaed tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:45.712258 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-89158e2b-153b-4b35-adfe-27dd5b5ddaed tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:45.712965 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-89158e2b-153b-4b35-adfe-27dd5b5ddaed tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:45.846900 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-89158e2b-153b-4b35-adfe-27dd5b5ddaed tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:45.854220 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-89158e2b-153b-4b35-adfe-27dd5b5ddaed tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd" status: 200 len: 1366 microversion: 2.1 time: 0.154796 Jun 07 09:29:45.854797 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 141/283] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:45 2022] GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:46.093405 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-d65e0d10-1bc1-4af3-8ac8-f07113bf8a99 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:46.094014 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-d65e0d10-1bc1-4af3-8ac8-f07113bf8a99 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:46.100105 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-d65e0d10-1bc1-4af3-8ac8-f07113bf8a99 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:46.100551 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-d65e0d10-1bc1-4af3-8ac8-f07113bf8a99 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:46.101336 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-d65e0d10-1bc1-4af3-8ac8-f07113bf8a99 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:46.101769 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-d65e0d10-1bc1-4af3-8ac8-f07113bf8a99 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:46.230130 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-d65e0d10-1bc1-4af3-8ac8-f07113bf8a99 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:46.244119 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-d65e0d10-1bc1-4af3-8ac8-f07113bf8a99 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:46.244119 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-d65e0d10-1bc1-4af3-8ac8-f07113bf8a99 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:46.244119 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-d65e0d10-1bc1-4af3-8ac8-f07113bf8a99 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1405 microversion: 2.20 time: 0.152151 Jun 07 09:29:46.244401 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 143/284] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:29:46 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1405 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:29:46.562815 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-91b33451-5b35-4e41-b109-6d43f014a976 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:46.563543 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-91b33451-5b35-4e41-b109-6d43f014a976 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:46.570352 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-91b33451-5b35-4e41-b109-6d43f014a976 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:46.570798 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-91b33451-5b35-4e41-b109-6d43f014a976 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:46.571639 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-91b33451-5b35-4e41-b109-6d43f014a976 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:46.572070 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-91b33451-5b35-4e41-b109-6d43f014a976 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:46.702421 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-91b33451-5b35-4e41-b109-6d43f014a976 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:46.709913 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-91b33451-5b35-4e41-b109-6d43f014a976 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4" status: 200 len: 1321 microversion: 2.1 time: 0.150937 Jun 07 09:29:46.710478 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 142/285] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:46 2022] GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4 => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:46.872605 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-81d36847-57a0-491d-879f-a32e3e23ac30 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:46.873322 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-81d36847-57a0-491d-879f-a32e3e23ac30 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 0e41026b-9a96-47df-a158-d8ea485025bd] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:46.879883 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-81d36847-57a0-491d-879f-a32e3e23ac30 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:46.880339 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-81d36847-57a0-491d-879f-a32e3e23ac30 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:46.881148 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-81d36847-57a0-491d-879f-a32e3e23ac30 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:46.881587 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-81d36847-57a0-491d-879f-a32e3e23ac30 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:47.008425 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-81d36847-57a0-491d-879f-a32e3e23ac30 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:47.015908 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-81d36847-57a0-491d-879f-a32e3e23ac30 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd" status: 200 len: 1366 microversion: 2.1 time: 0.148292 Jun 07 09:29:47.016469 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 144/286] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:46 2022] GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:47.259393 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-197b5121-9171-4399-a17e-36738f7538a6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:47.259994 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-197b5121-9171-4399-a17e-36738f7538a6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:47.266774 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-197b5121-9171-4399-a17e-36738f7538a6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:47.267236 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-197b5121-9171-4399-a17e-36738f7538a6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:47.268005 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-197b5121-9171-4399-a17e-36738f7538a6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:47.268487 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-197b5121-9171-4399-a17e-36738f7538a6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:47.609173 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-197b5121-9171-4399-a17e-36738f7538a6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:47.627442 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-197b5121-9171-4399-a17e-36738f7538a6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:47.631944 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-197b5121-9171-4399-a17e-36738f7538a6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:47.634547 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-197b5121-9171-4399-a17e-36738f7538a6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1405 microversion: 2.20 time: 0.379027 Jun 07 09:29:47.635682 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 143/287] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:29:47 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1405 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:29:47.726868 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-ab91040e-c079-4b2d-a448-828b98fa5572 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:47.727594 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-ab91040e-c079-4b2d-a448-828b98fa5572 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:47.735251 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-ab91040e-c079-4b2d-a448-828b98fa5572 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:47.735901 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-ab91040e-c079-4b2d-a448-828b98fa5572 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:47.736809 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-ab91040e-c079-4b2d-a448-828b98fa5572 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:47.737487 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-ab91040e-c079-4b2d-a448-828b98fa5572 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:47.879651 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-ab91040e-c079-4b2d-a448-828b98fa5572 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:47.887967 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-ab91040e-c079-4b2d-a448-828b98fa5572 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4" status: 200 len: 1321 microversion: 2.1 time: 0.164532 Jun 07 09:29:47.888810 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 145/288] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:47 2022] GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4 => generated 1321 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:48.032428 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-fdf4102f-9530-4dc5-af95-acb73de1e79f tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:48.033089 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-fdf4102f-9530-4dc5-af95-acb73de1e79f tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 0e41026b-9a96-47df-a158-d8ea485025bd] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:48.039035 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-fdf4102f-9530-4dc5-af95-acb73de1e79f tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:48.039469 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-fdf4102f-9530-4dc5-af95-acb73de1e79f tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:48.040220 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-fdf4102f-9530-4dc5-af95-acb73de1e79f tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:48.040676 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-fdf4102f-9530-4dc5-af95-acb73de1e79f tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:48.174667 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-fdf4102f-9530-4dc5-af95-acb73de1e79f tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:48.183141 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-fdf4102f-9530-4dc5-af95-acb73de1e79f tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd" status: 200 len: 1366 microversion: 2.1 time: 0.153630 Jun 07 09:29:48.193620 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 144/289] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:48 2022] GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:48.426849 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [req-e04e3235-6aff-4e30-ada6-3b36d3d7da98 req-6f68f877-caec-4e14-91be-e50e34d19475 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "102039c7-8224-43f7-9fb8-90b82968cfa2", "name": "network-vif-plugged", "status": "completed", "tag": "647bfcc4-5bf0-429c-803e-b72ea4c0fa25"}]} {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:29:48.436673 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [req-e04e3235-6aff-4e30-ada6-3b36d3d7da98 req-6f68f877-caec-4e14-91be-e50e34d19475 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:48.437120 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [req-e04e3235-6aff-4e30-ada6-3b36d3d7da98 req-6f68f877-caec-4e14-91be-e50e34d19475 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:48.450676 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.compute.server_external_events [req-e04e3235-6aff-4e30-ada6-3b36d3d7da98 req-6f68f877-caec-4e14-91be-e50e34d19475 service nova] Creating event network-vif-plugged:647bfcc4-5bf0-429c-803e-b72ea4c0fa25 for instance 102039c7-8224-43f7-9fb8-90b82968cfa2 on hv-cinder-83699 Jun 07 09:29:48.456298 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [req-e04e3235-6aff-4e30-ada6-3b36d3d7da98 req-6f68f877-caec-4e14-91be-e50e34d19475 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033747 Jun 07 09:29:48.457139 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 146/290] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Jun 7 09:29:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:29:48.653690 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-64ed1a49-6431-4bfe-92d9-243bde35a775 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:48.654488 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-64ed1a49-6431-4bfe-92d9-243bde35a775 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:48.661446 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-64ed1a49-6431-4bfe-92d9-243bde35a775 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:48.661895 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-64ed1a49-6431-4bfe-92d9-243bde35a775 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:48.662659 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-64ed1a49-6431-4bfe-92d9-243bde35a775 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:48.663117 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-64ed1a49-6431-4bfe-92d9-243bde35a775 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:48.906634 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-7e38778f-c7d9-4e26-99aa-09e7b11b9508 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:48.907327 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-7e38778f-c7d9-4e26-99aa-09e7b11b9508 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:48.914176 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-7e38778f-c7d9-4e26-99aa-09e7b11b9508 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:48.914656 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-7e38778f-c7d9-4e26-99aa-09e7b11b9508 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:48.915456 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-7e38778f-c7d9-4e26-99aa-09e7b11b9508 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:48.915920 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-7e38778f-c7d9-4e26-99aa-09e7b11b9508 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:48.990285 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-64ed1a49-6431-4bfe-92d9-243bde35a775 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:48.998581 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-64ed1a49-6431-4bfe-92d9-243bde35a775 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:49.000060 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-64ed1a49-6431-4bfe-92d9-243bde35a775 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:49.001378 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-64ed1a49-6431-4bfe-92d9-243bde35a775 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1405 microversion: 2.20 time: 0.352248 Jun 07 09:29:49.016011 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 145/291] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:29:48 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1405 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:29:49.054059 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-7e38778f-c7d9-4e26-99aa-09e7b11b9508 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:49.062021 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-7e38778f-c7d9-4e26-99aa-09e7b11b9508 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4" status: 200 len: 1321 microversion: 2.1 time: 0.161422 Jun 07 09:29:49.062688 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 147/292] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:48 2022] GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4 => generated 1321 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:29:49.199905 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-64dce94a-5ff4-4ac0-8078-f2b62dac3799 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:49.200500 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-64dce94a-5ff4-4ac0-8078-f2b62dac3799 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 0e41026b-9a96-47df-a158-d8ea485025bd] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:49.206483 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-64dce94a-5ff4-4ac0-8078-f2b62dac3799 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:49.207096 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-64dce94a-5ff4-4ac0-8078-f2b62dac3799 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:49.207848 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-64dce94a-5ff4-4ac0-8078-f2b62dac3799 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:49.208272 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-64dce94a-5ff4-4ac0-8078-f2b62dac3799 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:49.338271 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-64dce94a-5ff4-4ac0-8078-f2b62dac3799 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:49.345630 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-64dce94a-5ff4-4ac0-8078-f2b62dac3799 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd" status: 200 len: 1366 microversion: 2.1 time: 0.150034 Jun 07 09:29:49.346404 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 146/293] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:49 2022] GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:50.019351 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-92d79d45-d459-4827-b73b-d5654bdf2883 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:50.019965 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-92d79d45-d459-4827-b73b-d5654bdf2883 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:50.026089 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-92d79d45-d459-4827-b73b-d5654bdf2883 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:50.026541 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-92d79d45-d459-4827-b73b-d5654bdf2883 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:50.027301 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-92d79d45-d459-4827-b73b-d5654bdf2883 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:50.027735 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-92d79d45-d459-4827-b73b-d5654bdf2883 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:50.079532 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-5369f4c9-82b4-4aa0-9496-b355aa21209e tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:50.080245 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-5369f4c9-82b4-4aa0-9496-b355aa21209e tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:50.087233 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-5369f4c9-82b4-4aa0-9496-b355aa21209e tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:50.087768 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-5369f4c9-82b4-4aa0-9496-b355aa21209e tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:50.088775 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-5369f4c9-82b4-4aa0-9496-b355aa21209e tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:50.089338 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-5369f4c9-82b4-4aa0-9496-b355aa21209e tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:50.197680 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-92d79d45-d459-4827-b73b-d5654bdf2883 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:50.206480 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-92d79d45-d459-4827-b73b-d5654bdf2883 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:50.210195 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-92d79d45-d459-4827-b73b-d5654bdf2883 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:50.211343 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-92d79d45-d459-4827-b73b-d5654bdf2883 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1405 microversion: 2.20 time: 0.195931 Jun 07 09:29:50.212985 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 148/294] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:29:50 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1405 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:29:50.257824 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-5369f4c9-82b4-4aa0-9496-b355aa21209e tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:50.266307 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-5369f4c9-82b4-4aa0-9496-b355aa21209e tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4" status: 200 len: 1321 microversion: 2.1 time: 0.190508 Jun 07 09:29:50.266905 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 147/295] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:50 2022] GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4 => generated 1321 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:29:50.362414 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-e1a2e0e3-8902-46ea-bacc-274c6fc62911 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:50.363033 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-e1a2e0e3-8902-46ea-bacc-274c6fc62911 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 0e41026b-9a96-47df-a158-d8ea485025bd] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:50.368892 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-e1a2e0e3-8902-46ea-bacc-274c6fc62911 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:50.369345 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-e1a2e0e3-8902-46ea-bacc-274c6fc62911 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:50.370127 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-e1a2e0e3-8902-46ea-bacc-274c6fc62911 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:50.370559 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-e1a2e0e3-8902-46ea-bacc-274c6fc62911 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:50.499933 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-e1a2e0e3-8902-46ea-bacc-274c6fc62911 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:50.507449 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-e1a2e0e3-8902-46ea-bacc-274c6fc62911 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd" status: 200 len: 1366 microversion: 2.1 time: 0.149162 Jun 07 09:29:50.508010 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 149/296] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:50 2022] GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:51.234096 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-8f6e00f4-63fd-4663-ab19-5e58e9a8b266 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:51.234939 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-8f6e00f4-63fd-4663-ab19-5e58e9a8b266 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:51.244408 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-8f6e00f4-63fd-4663-ab19-5e58e9a8b266 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:51.245215 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-8f6e00f4-63fd-4663-ab19-5e58e9a8b266 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:51.246281 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-8f6e00f4-63fd-4663-ab19-5e58e9a8b266 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:51.247346 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-8f6e00f4-63fd-4663-ab19-5e58e9a8b266 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:51.251751 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writing DB stats nova_cell1:SELECT=100 {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:29:51.287446 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-40da88a7-52ed-4a9e-ae70-1084462921fb tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:51.288239 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-40da88a7-52ed-4a9e-ae70-1084462921fb tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:51.296233 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-40da88a7-52ed-4a9e-ae70-1084462921fb tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:51.296709 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-40da88a7-52ed-4a9e-ae70-1084462921fb tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:51.297945 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-40da88a7-52ed-4a9e-ae70-1084462921fb tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:51.298536 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-40da88a7-52ed-4a9e-ae70-1084462921fb tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:51.424758 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-8f6e00f4-63fd-4663-ab19-5e58e9a8b266 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:51.435023 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-8f6e00f4-63fd-4663-ab19-5e58e9a8b266 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:51.436526 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-8f6e00f4-63fd-4663-ab19-5e58e9a8b266 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:51.437728 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-8f6e00f4-63fd-4663-ab19-5e58e9a8b266 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1405 microversion: 2.20 time: 0.211053 Jun 07 09:29:51.440795 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 148/297] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:29:51 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1405 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:29:51.466538 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-40da88a7-52ed-4a9e-ae70-1084462921fb tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:51.470352 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-40da88a7-52ed-4a9e-ae70-1084462921fb tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4" status: 200 len: 1321 microversion: 2.1 time: 0.191333 Jun 07 09:29:51.470912 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 150/298] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:51 2022] GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4 => generated 1321 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:51.524819 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-3825dbb9-2541-4195-a464-8c1e264ab1d0 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:51.525432 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-3825dbb9-2541-4195-a464-8c1e264ab1d0 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 0e41026b-9a96-47df-a158-d8ea485025bd] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:51.532222 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-3825dbb9-2541-4195-a464-8c1e264ab1d0 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:51.532716 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-3825dbb9-2541-4195-a464-8c1e264ab1d0 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:51.533486 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-3825dbb9-2541-4195-a464-8c1e264ab1d0 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:51.533921 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-3825dbb9-2541-4195-a464-8c1e264ab1d0 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:51.675861 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-3825dbb9-2541-4195-a464-8c1e264ab1d0 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:51.683770 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-3825dbb9-2541-4195-a464-8c1e264ab1d0 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd" status: 200 len: 1555 microversion: 2.1 time: 0.162776 Jun 07 09:29:51.684398 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 149/299] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:51 2022] GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd => generated 1555 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:51.702982 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-f2d502be-d4f0-4929-b154-0bdd8504dfcb tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:51.703473 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-f2d502be-d4f0-4929-b154-0bdd8504dfcb tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 0e41026b-9a96-47df-a158-d8ea485025bd] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:51.709697 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-f2d502be-d4f0-4929-b154-0bdd8504dfcb tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:51.710142 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-f2d502be-d4f0-4929-b154-0bdd8504dfcb tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:51.710896 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-f2d502be-d4f0-4929-b154-0bdd8504dfcb tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:51.711355 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-f2d502be-d4f0-4929-b154-0bdd8504dfcb tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:51.823289 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-f2d502be-d4f0-4929-b154-0bdd8504dfcb tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.124356 Jun 07 09:29:51.823882 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 151/300] 10.222.0.57 () {58 vars in 1274 bytes} [Tue Jun 7 09:29:51 2022] GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd/os-interface => generated 284 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:29:52.455620 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-2ecd75f0-cd73-4cc8-a841-b998733c1143 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:52.456242 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-2ecd75f0-cd73-4cc8-a841-b998733c1143 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:52.464388 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-2ecd75f0-cd73-4cc8-a841-b998733c1143 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:52.465129 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-2ecd75f0-cd73-4cc8-a841-b998733c1143 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:52.466194 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-2ecd75f0-cd73-4cc8-a841-b998733c1143 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:52.467056 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-2ecd75f0-cd73-4cc8-a841-b998733c1143 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:52.493380 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-6288473a-8295-4234-9b9e-63ada74e7ec7 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:52.494675 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-6288473a-8295-4234-9b9e-63ada74e7ec7 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:52.508247 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-6288473a-8295-4234-9b9e-63ada74e7ec7 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:52.509076 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-6288473a-8295-4234-9b9e-63ada74e7ec7 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:52.511275 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-6288473a-8295-4234-9b9e-63ada74e7ec7 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:52.511730 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-6288473a-8295-4234-9b9e-63ada74e7ec7 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:52.713372 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-2ecd75f0-cd73-4cc8-a841-b998733c1143 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:52.717406 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-2ecd75f0-cd73-4cc8-a841-b998733c1143 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:52.719717 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-2ecd75f0-cd73-4cc8-a841-b998733c1143 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:52.720950 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-2ecd75f0-cd73-4cc8-a841-b998733c1143 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1405 microversion: 2.20 time: 0.269137 Jun 07 09:29:52.721512 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 150/301] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:29:52 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1405 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:29:52.880181 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-6288473a-8295-4234-9b9e-63ada74e7ec7 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:52.880181 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-6288473a-8295-4234-9b9e-63ada74e7ec7 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4" status: 200 len: 1515 microversion: 2.1 time: 0.350638 Jun 07 09:29:52.880181 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 152/302] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:52 2022] GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4 => generated 1515 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:52.888645 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-9ea760e3-86ae-42b1-83b5-0345cccad111 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:29:52.889713 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-9ea760e3-86ae-42b1-83b5-0345cccad111 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:52.896127 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-9ea760e3-86ae-42b1-83b5-0345cccad111 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:52.896715 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-9ea760e3-86ae-42b1-83b5-0345cccad111 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:52.897545 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-9ea760e3-86ae-42b1-83b5-0345cccad111 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:52.897987 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-9ea760e3-86ae-42b1-83b5-0345cccad111 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:52.921148 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.objects.instance [None req-9ea760e3-86ae-42b1-83b5-0345cccad111 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lazy-loading 'flavor' on Instance uuid a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4 {{(pid=118740) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 09:29:53.408326 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-9ea760e3-86ae-42b1-83b5-0345cccad111 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "POST /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4/action" status: 200 len: 32 microversion: 2.1 time: 0.524334 Jun 07 09:29:53.413387 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 151/303] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Jun 7 09:29:52 2022] POST /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4/action => generated 32 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 07 09:29:53.419130 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-e7baa6ef-46eb-4047-93a3-dc2596e95567 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:53.419745 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-e7baa6ef-46eb-4047-93a3-dc2596e95567 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:53.427479 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-e7baa6ef-46eb-4047-93a3-dc2596e95567 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:53.428454 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-e7baa6ef-46eb-4047-93a3-dc2596e95567 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:53.429404 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-e7baa6ef-46eb-4047-93a3-dc2596e95567 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:53.429943 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-e7baa6ef-46eb-4047-93a3-dc2596e95567 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:53.673538 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-e7baa6ef-46eb-4047-93a3-dc2596e95567 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:53.684613 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-e7baa6ef-46eb-4047-93a3-dc2596e95567 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4" status: 200 len: 1521 microversion: 2.1 time: 0.269491 Jun 07 09:29:53.685448 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 153/304] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:53 2022] GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4 => generated 1521 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:53.741904 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-34b2cead-7def-4162-a4a2-6ea8cf53b890 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:53.743916 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-34b2cead-7def-4162-a4a2-6ea8cf53b890 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:53.754803 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-34b2cead-7def-4162-a4a2-6ea8cf53b890 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:53.755422 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-34b2cead-7def-4162-a4a2-6ea8cf53b890 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:53.756359 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-34b2cead-7def-4162-a4a2-6ea8cf53b890 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:53.757165 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-34b2cead-7def-4162-a4a2-6ea8cf53b890 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:53.782800 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [req-2f2a2261-4e2a-422b-9b50-78522f4c93cb req-7cb4a997-2b29-479e-9008-2cd21e515e29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e41026b-9a96-47df-a158-d8ea485025bd", "tag": "0f719a33-a29f-4d0f-8c3c-af19fd8fe82d"}]} {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:29:53.797725 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [req-2f2a2261-4e2a-422b-9b50-78522f4c93cb req-7cb4a997-2b29-479e-9008-2cd21e515e29 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:53.799739 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [req-2f2a2261-4e2a-422b-9b50-78522f4c93cb req-7cb4a997-2b29-479e-9008-2cd21e515e29 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:53.814861 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.compute.server_external_events [req-2f2a2261-4e2a-422b-9b50-78522f4c93cb req-7cb4a997-2b29-479e-9008-2cd21e515e29 service nova] Creating event network-changed:0f719a33-a29f-4d0f-8c3c-af19fd8fe82d for instance 0e41026b-9a96-47df-a158-d8ea485025bd on hv-cinder-83699 Jun 07 09:29:53.820647 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [req-2f2a2261-4e2a-422b-9b50-78522f4c93cb req-7cb4a997-2b29-479e-9008-2cd21e515e29 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041823 Jun 07 09:29:53.821242 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 154/305] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Jun 7 09:29:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:29:54.021682 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-34b2cead-7def-4162-a4a2-6ea8cf53b890 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:54.033511 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-34b2cead-7def-4162-a4a2-6ea8cf53b890 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:54.035461 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-34b2cead-7def-4162-a4a2-6ea8cf53b890 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:54.036835 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-34b2cead-7def-4162-a4a2-6ea8cf53b890 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1405 microversion: 2.20 time: 0.300826 Jun 07 09:29:54.038405 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 152/306] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:29:53 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1405 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:29:54.702144 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-2c442985-8b48-4bc3-8fbd-85453b5fd585 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:54.704060 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-2c442985-8b48-4bc3-8fbd-85453b5fd585 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:54.712222 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-2c442985-8b48-4bc3-8fbd-85453b5fd585 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:54.712918 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-2c442985-8b48-4bc3-8fbd-85453b5fd585 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:54.713755 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-2c442985-8b48-4bc3-8fbd-85453b5fd585 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:54.714328 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-2c442985-8b48-4bc3-8fbd-85453b5fd585 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:54.898861 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-2c442985-8b48-4bc3-8fbd-85453b5fd585 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:54.907063 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-2c442985-8b48-4bc3-8fbd-85453b5fd585 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4" status: 200 len: 1521 microversion: 2.1 time: 0.209183 Jun 07 09:29:54.907873 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 155/307] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:54 2022] GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4 => generated 1521 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:55.056023 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-7e4d787b-a161-46e8-9a82-5380a3074d27 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:55.056669 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-7e4d787b-a161-46e8-9a82-5380a3074d27 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:55.066736 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-7e4d787b-a161-46e8-9a82-5380a3074d27 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:55.067129 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-7e4d787b-a161-46e8-9a82-5380a3074d27 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:55.067925 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-7e4d787b-a161-46e8-9a82-5380a3074d27 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:55.068509 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-7e4d787b-a161-46e8-9a82-5380a3074d27 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:55.245648 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-7e4d787b-a161-46e8-9a82-5380a3074d27 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:55.255070 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-7e4d787b-a161-46e8-9a82-5380a3074d27 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:55.256557 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-7e4d787b-a161-46e8-9a82-5380a3074d27 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:55.257672 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-7e4d787b-a161-46e8-9a82-5380a3074d27 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1405 microversion: 2.20 time: 0.205884 Jun 07 09:29:55.258594 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 153/308] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:29:55 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1405 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:29:55.905143 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-35f0b99d-8da2-4137-818e-15f024af94f9 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1116750154", "imageRef": "8fdb0275-8c58-4c9e-a2f3-3aae3a947526", "flavorRef": "452"}} {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:29:55.924368 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-626da928-8396-4571-a52f-94cf67d9475d tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:55.925102 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-626da928-8396-4571-a52f-94cf67d9475d tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:55.931622 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-626da928-8396-4571-a52f-94cf67d9475d tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:55.932180 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-626da928-8396-4571-a52f-94cf67d9475d tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:55.933012 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-626da928-8396-4571-a52f-94cf67d9475d tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:55.933653 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-626da928-8396-4571-a52f-94cf67d9475d tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:55.958817 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.network.neutron [None req-35f0b99d-8da2-4137-818e-15f024af94f9 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] validate_networks() for None {{(pid=118741) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 09:29:56.075490 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-626da928-8396-4571-a52f-94cf67d9475d tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:56.084556 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-626da928-8396-4571-a52f-94cf67d9475d tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4" status: 200 len: 1521 microversion: 2.1 time: 0.164801 Jun 07 09:29:56.085529 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 154/309] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:55 2022] GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:29:56.245095 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.virt.hardware [None req-35f0b99d-8da2-4137-818e-15f024af94f9 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Flavor limits 0:0:0 {{(pid=118741) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 09:29:56.245095 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.virt.hardware [None req-35f0b99d-8da2-4137-818e-15f024af94f9 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Image limits 0:0:0 {{(pid=118741) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 09:29:56.245095 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.virt.hardware [None req-35f0b99d-8da2-4137-818e-15f024af94f9 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Flavor pref 0:0:0 {{(pid=118741) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 09:29:56.245095 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.virt.hardware [None req-35f0b99d-8da2-4137-818e-15f024af94f9 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Image pref 0:0:0 {{(pid=118741) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 09:29:56.245095 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.virt.hardware [None req-35f0b99d-8da2-4137-818e-15f024af94f9 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118741) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 09:29:56.254046 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-35f0b99d-8da2-4137-818e-15f024af94f9 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:56.254573 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-35f0b99d-8da2-4137-818e-15f024af94f9 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:56.255475 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-35f0b99d-8da2-4137-818e-15f024af94f9 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:56.255991 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-35f0b99d-8da2-4137-818e-15f024af94f9 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:56.275568 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-26b7bf94-e803-410d-8148-bf6d71c0adcc tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:56.275936 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.quota [None req-35f0b99d-8da2-4137-818e-15f024af94f9 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Getting quotas for project 44089f44ea384df88ea8e9411dc94476. Resources: {'instances', 'cores', 'ram'} {{(pid=118741) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 09:29:56.276618 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-26b7bf94-e803-410d-8148-bf6d71c0adcc tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:56.286417 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.quota [None req-35f0b99d-8da2-4137-818e-15f024af94f9 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Getting quotas for user 7e44a60fc7244d6d88a20aeac53c3353 and project 44089f44ea384df88ea8e9411dc94476. Resources: {'instances', 'cores', 'ram'} {{(pid=118741) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 09:29:56.286715 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-26b7bf94-e803-410d-8148-bf6d71c0adcc tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:56.286715 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-26b7bf94-e803-410d-8148-bf6d71c0adcc tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:56.286715 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-26b7bf94-e803-410d-8148-bf6d71c0adcc tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:56.286715 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-26b7bf94-e803-410d-8148-bf6d71c0adcc tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:56.299438 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-35f0b99d-8da2-4137-818e-15f024af94f9 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Going to run 1 instances... {{(pid=118741) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 09:29:56.301833 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-35f0b99d-8da2-4137-818e-15f024af94f9 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] [instance: 6644ea64-dd17-4874-b6ed-9a19b951a3a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8fdb0275-8c58-4c9e-a2f3-3aae3a947526',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118741) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 09:29:56.461218 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-26b7bf94-e803-410d-8148-bf6d71c0adcc tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:56.472205 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-26b7bf94-e803-410d-8148-bf6d71c0adcc tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:56.473771 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-26b7bf94-e803-410d-8148-bf6d71c0adcc tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:56.475108 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-26b7bf94-e803-410d-8148-bf6d71c0adcc tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1405 microversion: 2.20 time: 0.203513 Jun 07 09:29:56.475851 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 155/310] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:29:56 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1405 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 09:29:56.501801 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-35f0b99d-8da2-4137-818e-15f024af94f9 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.608676 Jun 07 09:29:56.507837 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 156/311] 10.222.0.57 () {60 vars in 1146 bytes} [Tue Jun 7 09:29:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 615 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 09:29:56.513343 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-cd5b5688-295d-4349-99cc-8c858bae47de tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:56.514669 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-cd5b5688-295d-4349-99cc-8c858bae47de tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] [instance: 6644ea64-dd17-4874-b6ed-9a19b951a3a3] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:56.629071 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-cd5b5688-295d-4349-99cc-8c858bae47de tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e44a60fc7244d6d88a20aeac53c3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44089f44ea384df88ea8e9411dc94476', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:56.638419 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-cd5b5688-295d-4349-99cc-8c858bae47de tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] 10.222.0.57 "GET /compute/v2.1/servers/6644ea64-dd17-4874-b6ed-9a19b951a3a3" status: 200 len: 1215 microversion: 2.1 time: 0.129561 Jun 07 09:29:56.642906 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 156/312] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:56 2022] GET /compute/v2.1/servers/6644ea64-dd17-4874-b6ed-9a19b951a3a3 => generated 1215 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:57.102298 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-85ceba88-5d9a-4d11-b917-b949f2ac60ff tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:57.103201 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-85ceba88-5d9a-4d11-b917-b949f2ac60ff tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:57.110369 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-85ceba88-5d9a-4d11-b917-b949f2ac60ff tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:57.110822 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-85ceba88-5d9a-4d11-b917-b949f2ac60ff tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:57.111586 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-85ceba88-5d9a-4d11-b917-b949f2ac60ff tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:57.112023 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-85ceba88-5d9a-4d11-b917-b949f2ac60ff tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:57.128784 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writing DB stats nova_cell1:SELECT=100 {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:29:57.252711 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-85ceba88-5d9a-4d11-b917-b949f2ac60ff tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:57.261278 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-85ceba88-5d9a-4d11-b917-b949f2ac60ff tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4" status: 200 len: 1521 microversion: 2.1 time: 0.162894 Jun 07 09:29:57.262491 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 157/313] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:57 2022] GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:57.494289 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-dbb38389-2cec-4ae4-babc-d744ff9b2944 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:57.494892 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-dbb38389-2cec-4ae4-babc-d744ff9b2944 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:57.503834 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-dbb38389-2cec-4ae4-babc-d744ff9b2944 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:57.503834 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-dbb38389-2cec-4ae4-babc-d744ff9b2944 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:57.503834 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-dbb38389-2cec-4ae4-babc-d744ff9b2944 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:57.503834 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-dbb38389-2cec-4ae4-babc-d744ff9b2944 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:57.661681 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-6399c835-0bf6-43e3-bf50-db2404e1b2ae tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:57.662336 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-6399c835-0bf6-43e3-bf50-db2404e1b2ae tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] [instance: 6644ea64-dd17-4874-b6ed-9a19b951a3a3] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:57.669881 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-dbb38389-2cec-4ae4-babc-d744ff9b2944 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:57.685660 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-dbb38389-2cec-4ae4-babc-d744ff9b2944 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:57.687192 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-dbb38389-2cec-4ae4-babc-d744ff9b2944 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:57.688359 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-dbb38389-2cec-4ae4-babc-d744ff9b2944 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1596 microversion: 2.20 time: 0.198122 Jun 07 09:29:57.693103 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 157/314] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:29:57 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1596 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:29:57.716858 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-0c5e6ee3-ef6d-4e8f-b288-31d180b0f9b2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:57.717375 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-0c5e6ee3-ef6d-4e8f-b288-31d180b0f9b2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:57.724392 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-0c5e6ee3-ef6d-4e8f-b288-31d180b0f9b2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:57.725087 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-0c5e6ee3-ef6d-4e8f-b288-31d180b0f9b2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:57.741178 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-0c5e6ee3-ef6d-4e8f-b288-31d180b0f9b2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:57.741922 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-0c5e6ee3-ef6d-4e8f-b288-31d180b0f9b2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:57.766358 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-6399c835-0bf6-43e3-bf50-db2404e1b2ae tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e44a60fc7244d6d88a20aeac53c3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44089f44ea384df88ea8e9411dc94476', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:57.775848 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-6399c835-0bf6-43e3-bf50-db2404e1b2ae tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] 10.222.0.57 "GET /compute/v2.1/servers/6644ea64-dd17-4874-b6ed-9a19b951a3a3" status: 200 len: 1215 microversion: 2.1 time: 0.117889 Jun 07 09:29:57.784835 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 158/315] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:57 2022] GET /compute/v2.1/servers/6644ea64-dd17-4874-b6ed-9a19b951a3a3 => generated 1215 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:29:57.828235 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-8d96c115-8d4f-41aa-a41e-64ce9400b150 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:57.828759 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-8d96c115-8d4f-41aa-a41e-64ce9400b150 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] [instance: 90803094-e09d-4c65-9aba-88d612d0dafd] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:57.835214 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-8d96c115-8d4f-41aa-a41e-64ce9400b150 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:57.835750 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-8d96c115-8d4f-41aa-a41e-64ce9400b150 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:57.836510 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-8d96c115-8d4f-41aa-a41e-64ce9400b150 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:57.836995 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-8d96c115-8d4f-41aa-a41e-64ce9400b150 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:57.848668 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-0c5e6ee3-ef6d-4e8f-b288-31d180b0f9b2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.137290 Jun 07 09:29:57.854985 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 158/316] 10.222.0.57 () {60 vars in 1315 bytes} [Tue Jun 7 09:29:57 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2/os-interface => generated 285 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 09:29:57.879481 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-8d96c115-8d4f-41aa-a41e-64ce9400b150 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] [instance: 90803094-e09d-4c65-9aba-88d612d0dafd] Going to try to terminate instance {{(pid=118741) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 09:29:58.279191 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-87838c8a-288b-4c85-8221-dd963cb09176 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:58.279701 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-87838c8a-288b-4c85-8221-dd963cb09176 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:58.286132 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-87838c8a-288b-4c85-8221-dd963cb09176 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:58.286836 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-87838c8a-288b-4c85-8221-dd963cb09176 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:58.287774 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-87838c8a-288b-4c85-8221-dd963cb09176 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:58.288202 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-87838c8a-288b-4c85-8221-dd963cb09176 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:58.301768 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-8d96c115-8d4f-41aa-a41e-64ce9400b150 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] 10.222.0.57 "DELETE /compute/v2.1/servers/90803094-e09d-4c65-9aba-88d612d0dafd" status: 204 len: 0 microversion: 2.1 time: 0.479123 Jun 07 09:29:58.304851 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 159/317] 10.222.0.57 () {58 vars in 1238 bytes} [Tue Jun 7 09:29:57 2022] DELETE /compute/v2.1/servers/90803094-e09d-4c65-9aba-88d612d0dafd => generated 0 bytes in 482 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 07 09:29:58.312408 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-505d976c-72d4-474b-9978-3fb95d4111ea tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:58.315622 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-505d976c-72d4-474b-9978-3fb95d4111ea tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] [instance: 90803094-e09d-4c65-9aba-88d612d0dafd] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:58.321015 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-505d976c-72d4-474b-9978-3fb95d4111ea tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:58.322706 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-505d976c-72d4-474b-9978-3fb95d4111ea tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:58.323571 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-505d976c-72d4-474b-9978-3fb95d4111ea tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:58.324108 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-505d976c-72d4-474b-9978-3fb95d4111ea tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:58.454521 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-87838c8a-288b-4c85-8221-dd963cb09176 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:58.463695 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-87838c8a-288b-4c85-8221-dd963cb09176 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4" status: 200 len: 1521 microversion: 2.1 time: 0.188721 Jun 07 09:29:58.464671 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 159/318] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:58 2022] GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4 => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:58.552028 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-505d976c-72d4-474b-9978-3fb95d4111ea tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9726e11bda974054a1e972c097b1ea1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986f0a9e430e4caaaed4affc2d4b8aeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:58.560806 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-505d976c-72d4-474b-9978-3fb95d4111ea tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] 10.222.0.57 "GET /compute/v2.1/servers/90803094-e09d-4c65-9aba-88d612d0dafd" status: 200 len: 1553 microversion: 2.1 time: 0.252849 Jun 07 09:29:58.561379 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 160/319] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:58 2022] GET /compute/v2.1/servers/90803094-e09d-4c65-9aba-88d612d0dafd => generated 1553 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:58.795162 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-c21844a5-b4a4-46c2-8245-9c9684c7eef8 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:58.796642 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-c21844a5-b4a4-46c2-8245-9c9684c7eef8 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] [instance: 6644ea64-dd17-4874-b6ed-9a19b951a3a3] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:58.805148 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-c21844a5-b4a4-46c2-8245-9c9684c7eef8 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:58.805808 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-c21844a5-b4a4-46c2-8245-9c9684c7eef8 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:58.806666 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-c21844a5-b4a4-46c2-8245-9c9684c7eef8 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:58.807168 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-c21844a5-b4a4-46c2-8245-9c9684c7eef8 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:58.872863 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-c21844a5-b4a4-46c2-8245-9c9684c7eef8 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e44a60fc7244d6d88a20aeac53c3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44089f44ea384df88ea8e9411dc94476', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:58.887112 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-c21844a5-b4a4-46c2-8245-9c9684c7eef8 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] 10.222.0.57 "GET /compute/v2.1/servers/6644ea64-dd17-4874-b6ed-9a19b951a3a3" status: 200 len: 1211 microversion: 2.1 time: 0.096840 Jun 07 09:29:58.887886 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 160/320] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:58 2022] GET /compute/v2.1/servers/6644ea64-dd17-4874-b6ed-9a19b951a3a3 => generated 1211 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:58.967620 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [req-fe166410-7ae6-4151-9d27-1c181cb189cb req-96f7f749-7709-4c0f-b144-d55ea39e45e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "102039c7-8224-43f7-9fb8-90b82968cfa2", "tag": "647bfcc4-5bf0-429c-803e-b72ea4c0fa25"}]} {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:29:58.977129 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [req-fe166410-7ae6-4151-9d27-1c181cb189cb req-96f7f749-7709-4c0f-b144-d55ea39e45e0 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:58.979667 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [req-fe166410-7ae6-4151-9d27-1c181cb189cb req-96f7f749-7709-4c0f-b144-d55ea39e45e0 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:59.002959 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.compute.server_external_events [req-fe166410-7ae6-4151-9d27-1c181cb189cb req-96f7f749-7709-4c0f-b144-d55ea39e45e0 service nova] Creating event network-changed:647bfcc4-5bf0-429c-803e-b72ea4c0fa25 for instance 102039c7-8224-43f7-9fb8-90b82968cfa2 on hv-cinder-83699 Jun 07 09:29:59.016251 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [req-fe166410-7ae6-4151-9d27-1c181cb189cb req-96f7f749-7709-4c0f-b144-d55ea39e45e0 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052407 Jun 07 09:29:59.017298 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 161/321] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Jun 7 09:29:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:29:59.481179 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-0e736c0c-c361-4656-9a93-a64868686848 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:59.481796 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-0e736c0c-c361-4656-9a93-a64868686848 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:59.488291 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-0e736c0c-c361-4656-9a93-a64868686848 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:59.489026 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-0e736c0c-c361-4656-9a93-a64868686848 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:59.489834 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-0e736c0c-c361-4656-9a93-a64868686848 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:59.490275 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-0e736c0c-c361-4656-9a93-a64868686848 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:59.581811 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-65db7fa9-8761-45b4-ac28-f1aea3722424 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:59.588045 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-65db7fa9-8761-45b4-ac28-f1aea3722424 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] [instance: 90803094-e09d-4c65-9aba-88d612d0dafd] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:59.590774 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-65db7fa9-8761-45b4-ac28-f1aea3722424 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:59.591448 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-65db7fa9-8761-45b4-ac28-f1aea3722424 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:59.592406 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-65db7fa9-8761-45b4-ac28-f1aea3722424 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:59.593072 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-65db7fa9-8761-45b4-ac28-f1aea3722424 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:59.639634 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-0e736c0c-c361-4656-9a93-a64868686848 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:59.648251 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-0e736c0c-c361-4656-9a93-a64868686848 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4" status: 200 len: 1521 microversion: 2.1 time: 0.170449 Jun 07 09:29:59.648489 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 161/322] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:59 2022] GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:29:59.760422 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-65db7fa9-8761-45b4-ac28-f1aea3722424 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9726e11bda974054a1e972c097b1ea1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986f0a9e430e4caaaed4affc2d4b8aeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:59.765027 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-65db7fa9-8761-45b4-ac28-f1aea3722424 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] 10.222.0.57 "GET /compute/v2.1/servers/90803094-e09d-4c65-9aba-88d612d0dafd" status: 200 len: 1553 microversion: 2.1 time: 0.190929 Jun 07 09:29:59.765737 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 162/323] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:59 2022] GET /compute/v2.1/servers/90803094-e09d-4c65-9aba-88d612d0dafd => generated 1553 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:29:59.904465 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-661362c3-a6f6-4920-aec7-182f8d8aa49d tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:29:59.905110 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-661362c3-a6f6-4920-aec7-182f8d8aa49d tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] [instance: 6644ea64-dd17-4874-b6ed-9a19b951a3a3] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:29:59.913935 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-661362c3-a6f6-4920-aec7-182f8d8aa49d tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:59.913935 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-661362c3-a6f6-4920-aec7-182f8d8aa49d tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:59.913935 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-661362c3-a6f6-4920-aec7-182f8d8aa49d tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:29:59.914239 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-661362c3-a6f6-4920-aec7-182f8d8aa49d tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:29:59.990248 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-661362c3-a6f6-4920-aec7-182f8d8aa49d tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e44a60fc7244d6d88a20aeac53c3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44089f44ea384df88ea8e9411dc94476', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:29:59.999123 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-661362c3-a6f6-4920-aec7-182f8d8aa49d tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] 10.222.0.57 "GET /compute/v2.1/servers/6644ea64-dd17-4874-b6ed-9a19b951a3a3" status: 200 len: 1211 microversion: 2.1 time: 0.098620 Jun 07 09:29:59.999832 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 162/324] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:29:59 2022] GET /compute/v2.1/servers/6644ea64-dd17-4874-b6ed-9a19b951a3a3 => generated 1211 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:30:00.664525 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-65f301ba-e6b6-4c3f-880b-95b1b6816589 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:30:00.665174 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-65f301ba-e6b6-4c3f-880b-95b1b6816589 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:30:00.671209 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-65f301ba-e6b6-4c3f-880b-95b1b6816589 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:00.671653 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-65f301ba-e6b6-4c3f-880b-95b1b6816589 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:00.672407 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-65f301ba-e6b6-4c3f-880b-95b1b6816589 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:00.672864 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-65f301ba-e6b6-4c3f-880b-95b1b6816589 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:00.783228 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-4631ac35-0900-413d-bc43-7af0df449012 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:30:00.786301 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-4631ac35-0900-413d-bc43-7af0df449012 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] [instance: 90803094-e09d-4c65-9aba-88d612d0dafd] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:30:00.793168 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-4631ac35-0900-413d-bc43-7af0df449012 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:00.793704 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-4631ac35-0900-413d-bc43-7af0df449012 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:00.794751 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-4631ac35-0900-413d-bc43-7af0df449012 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:00.795498 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-4631ac35-0900-413d-bc43-7af0df449012 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:00.886214 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-65f301ba-e6b6-4c3f-880b-95b1b6816589 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:30:00.894520 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-65f301ba-e6b6-4c3f-880b-95b1b6816589 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4" status: 200 len: 1521 microversion: 2.1 time: 0.233758 Jun 07 09:30:00.895211 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 163/325] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:30:00 2022] GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4 => generated 1521 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:30:00.931473 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-4631ac35-0900-413d-bc43-7af0df449012 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9726e11bda974054a1e972c097b1ea1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986f0a9e430e4caaaed4affc2d4b8aeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:30:00.940314 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-4631ac35-0900-413d-bc43-7af0df449012 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] 10.222.0.57 "GET /compute/v2.1/servers/90803094-e09d-4c65-9aba-88d612d0dafd" status: 200 len: 1553 microversion: 2.1 time: 0.161705 Jun 07 09:30:00.940914 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 163/326] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:30:00 2022] GET /compute/v2.1/servers/90803094-e09d-4c65-9aba-88d612d0dafd => generated 1553 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:30:01.016344 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-113aabfb-1705-499e-8034-dd813ad82089 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:30:01.017047 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-113aabfb-1705-499e-8034-dd813ad82089 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] [instance: 6644ea64-dd17-4874-b6ed-9a19b951a3a3] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:30:01.019022 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:30:01.030254 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-113aabfb-1705-499e-8034-dd813ad82089 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:01.033083 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-113aabfb-1705-499e-8034-dd813ad82089 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:01.033083 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-113aabfb-1705-499e-8034-dd813ad82089 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:01.033083 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-113aabfb-1705-499e-8034-dd813ad82089 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:01.093679 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-113aabfb-1705-499e-8034-dd813ad82089 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e44a60fc7244d6d88a20aeac53c3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44089f44ea384df88ea8e9411dc94476', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:30:01.101123 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-113aabfb-1705-499e-8034-dd813ad82089 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] 10.222.0.57 "GET /compute/v2.1/servers/6644ea64-dd17-4874-b6ed-9a19b951a3a3" status: 200 len: 1267 microversion: 2.1 time: 0.088525 Jun 07 09:30:01.101676 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 164/327] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:30:01 2022] GET /compute/v2.1/servers/6644ea64-dd17-4874-b6ed-9a19b951a3a3 => generated 1267 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:30:01.913178 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-ba665153-5207-45a2-8dd9-1ef96d193dce tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:30:01.914288 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-ba665153-5207-45a2-8dd9-1ef96d193dce tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:30:01.925427 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-ba665153-5207-45a2-8dd9-1ef96d193dce tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:01.926208 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-ba665153-5207-45a2-8dd9-1ef96d193dce tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:01.927925 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-ba665153-5207-45a2-8dd9-1ef96d193dce tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:01.928575 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-ba665153-5207-45a2-8dd9-1ef96d193dce tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:01.934976 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:30:01.957760 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-a3a0f3b3-8138-47ba-8242-2c9f4e920dca tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:30:01.958767 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-a3a0f3b3-8138-47ba-8242-2c9f4e920dca tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] [instance: 90803094-e09d-4c65-9aba-88d612d0dafd] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:30:01.969547 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-a3a0f3b3-8138-47ba-8242-2c9f4e920dca tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:01.970770 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-a3a0f3b3-8138-47ba-8242-2c9f4e920dca tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:01.973833 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-a3a0f3b3-8138-47ba-8242-2c9f4e920dca tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:01.975217 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-a3a0f3b3-8138-47ba-8242-2c9f4e920dca tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:02.169926 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-ba665153-5207-45a2-8dd9-1ef96d193dce tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:30:02.178180 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-ba665153-5207-45a2-8dd9-1ef96d193dce tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4" status: 200 len: 1521 microversion: 2.1 time: 0.270359 Jun 07 09:30:02.178897 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 164/328] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:30:01 2022] GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4 => generated 1521 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:30:02.184737 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-5700225f-888a-4928-95b2-5a6c79dc976e tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:30:02.185947 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-5700225f-888a-4928-95b2-5a6c79dc976e tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] [instance: 6644ea64-dd17-4874-b6ed-9a19b951a3a3] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:30:02.193517 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-5700225f-888a-4928-95b2-5a6c79dc976e tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:02.195003 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-5700225f-888a-4928-95b2-5a6c79dc976e tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:02.196182 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-5700225f-888a-4928-95b2-5a6c79dc976e tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:02.196881 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-5700225f-888a-4928-95b2-5a6c79dc976e tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:02.204617 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-a3a0f3b3-8138-47ba-8242-2c9f4e920dca tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9726e11bda974054a1e972c097b1ea1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986f0a9e430e4caaaed4affc2d4b8aeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:30:02.213275 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-a3a0f3b3-8138-47ba-8242-2c9f4e920dca tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] 10.222.0.57 "GET /compute/v2.1/servers/90803094-e09d-4c65-9aba-88d612d0dafd" status: 200 len: 1553 microversion: 2.1 time: 0.259331 Jun 07 09:30:02.223183 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 165/329] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:30:01 2022] GET /compute/v2.1/servers/90803094-e09d-4c65-9aba-88d612d0dafd => generated 1553 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:30:02.260888 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-5700225f-888a-4928-95b2-5a6c79dc976e tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e44a60fc7244d6d88a20aeac53c3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44089f44ea384df88ea8e9411dc94476', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:30:02.269580 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-5700225f-888a-4928-95b2-5a6c79dc976e tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] 10.222.0.57 "GET /compute/v2.1/servers/6644ea64-dd17-4874-b6ed-9a19b951a3a3" status: 200 len: 1285 microversion: 2.1 time: 0.089259 Jun 07 09:30:02.270143 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 165/330] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:30:02 2022] GET /compute/v2.1/servers/6644ea64-dd17-4874-b6ed-9a19b951a3a3 => generated 1285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:30:02.451866 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [req-ca5581dd-10e8-4a76-ad41-b05813510402 req-f6b4a95f-1423-484a-958f-29375e4e3c3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90803094-e09d-4c65-9aba-88d612d0dafd", "name": "network-vif-deleted", "tag": "919af0e4-f81f-4aea-8fcf-3f4ce64021c4"}]} {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:30:02.459997 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [req-ca5581dd-10e8-4a76-ad41-b05813510402 req-f6b4a95f-1423-484a-958f-29375e4e3c3e service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:02.460436 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [req-ca5581dd-10e8-4a76-ad41-b05813510402 req-f6b4a95f-1423-484a-958f-29375e4e3c3e service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:02.471907 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.compute.server_external_events [req-ca5581dd-10e8-4a76-ad41-b05813510402 req-f6b4a95f-1423-484a-958f-29375e4e3c3e service nova] Creating event network-vif-deleted:919af0e4-f81f-4aea-8fcf-3f4ce64021c4 for instance 90803094-e09d-4c65-9aba-88d612d0dafd on hv-cinder-83699 Jun 07 09:30:02.476879 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [req-ca5581dd-10e8-4a76-ad41-b05813510402 req-f6b4a95f-1423-484a-958f-29375e4e3c3e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029077 Jun 07 09:30:02.477480 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 166/331] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Jun 7 09:30:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:30:03.197989 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-d2baa67b-ceba-4283-9195-e66b78ea221e tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:30:03.198673 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-d2baa67b-ceba-4283-9195-e66b78ea221e tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:30:03.208637 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-d2baa67b-ceba-4283-9195-e66b78ea221e tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:03.209321 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-d2baa67b-ceba-4283-9195-e66b78ea221e tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:03.210355 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-d2baa67b-ceba-4283-9195-e66b78ea221e tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:03.210760 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-d2baa67b-ceba-4283-9195-e66b78ea221e tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:03.231029 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-f411a376-d3ee-40d2-9634-7e48141de7be tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:30:03.235655 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-f411a376-d3ee-40d2-9634-7e48141de7be tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] [instance: 90803094-e09d-4c65-9aba-88d612d0dafd] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:30:03.241645 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-f411a376-d3ee-40d2-9634-7e48141de7be tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:03.242112 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-f411a376-d3ee-40d2-9634-7e48141de7be tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:03.246207 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-f411a376-d3ee-40d2-9634-7e48141de7be tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:03.246633 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-f411a376-d3ee-40d2-9634-7e48141de7be tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:03.331595 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-f411a376-d3ee-40d2-9634-7e48141de7be tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9726e11bda974054a1e972c097b1ea1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986f0a9e430e4caaaed4affc2d4b8aeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:30:03.340832 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-f411a376-d3ee-40d2-9634-7e48141de7be tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] 10.222.0.57 "GET /compute/v2.1/servers/90803094-e09d-4c65-9aba-88d612d0dafd" status: 200 len: 1345 microversion: 2.1 time: 0.114007 Jun 07 09:30:03.341532 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 167/332] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:30:03 2022] GET /compute/v2.1/servers/90803094-e09d-4c65-9aba-88d612d0dafd => generated 1345 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:30:03.346181 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-d81f48d1-6d17-4969-b187-1047ea890866 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:30:03.347166 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-d81f48d1-6d17-4969-b187-1047ea890866 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] [instance: 6644ea64-dd17-4874-b6ed-9a19b951a3a3] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:30:03.355362 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-d81f48d1-6d17-4969-b187-1047ea890866 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:03.355879 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-d81f48d1-6d17-4969-b187-1047ea890866 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:03.356740 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-d81f48d1-6d17-4969-b187-1047ea890866 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:03.357585 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-d81f48d1-6d17-4969-b187-1047ea890866 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:03.437587 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-d2baa67b-ceba-4283-9195-e66b78ea221e tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:30:03.445586 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-d2baa67b-ceba-4283-9195-e66b78ea221e tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4" status: 200 len: 1521 microversion: 2.1 time: 0.251480 Jun 07 09:30:03.446164 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 166/333] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:30:03 2022] GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4 => generated 1521 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:30:03.590015 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-d81f48d1-6d17-4969-b187-1047ea890866 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e44a60fc7244d6d88a20aeac53c3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44089f44ea384df88ea8e9411dc94476', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:30:03.597401 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-d81f48d1-6d17-4969-b187-1047ea890866 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] 10.222.0.57 "GET /compute/v2.1/servers/6644ea64-dd17-4874-b6ed-9a19b951a3a3" status: 200 len: 1315 microversion: 2.1 time: 0.254876 Jun 07 09:30:03.597960 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 168/334] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:30:03 2022] GET /compute/v2.1/servers/6644ea64-dd17-4874-b6ed-9a19b951a3a3 => generated 1315 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:30:04.360126 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [req-05f49dca-6066-413c-a26a-28ead4c26e94 req-ba64d1d5-0c81-4ac2-8e90-59e38156256d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6644ea64-dd17-4874-b6ed-9a19b951a3a3", "tag": "70ed00d8-0269-4fd7-95ad-a77218f83e0d"}]} {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:30:04.360712 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-647dec65-ee32-4829-9979-7e1a7f6153cc tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:30:04.361761 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-647dec65-ee32-4829-9979-7e1a7f6153cc tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] [instance: 90803094-e09d-4c65-9aba-88d612d0dafd] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:30:04.375072 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-647dec65-ee32-4829-9979-7e1a7f6153cc tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:04.375559 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-647dec65-ee32-4829-9979-7e1a7f6153cc tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:04.376531 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-647dec65-ee32-4829-9979-7e1a7f6153cc tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:04.377070 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-647dec65-ee32-4829-9979-7e1a7f6153cc tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:04.378016 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [req-05f49dca-6066-413c-a26a-28ead4c26e94 req-ba64d1d5-0c81-4ac2-8e90-59e38156256d service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:04.378488 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [req-05f49dca-6066-413c-a26a-28ead4c26e94 req-ba64d1d5-0c81-4ac2-8e90-59e38156256d service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:04.407829 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.compute.server_external_events [req-05f49dca-6066-413c-a26a-28ead4c26e94 req-ba64d1d5-0c81-4ac2-8e90-59e38156256d service nova] Creating event network-changed:70ed00d8-0269-4fd7-95ad-a77218f83e0d for instance 6644ea64-dd17-4874-b6ed-9a19b951a3a3 on hv-cinder-83699 Jun 07 09:30:04.413220 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [req-05f49dca-6066-413c-a26a-28ead4c26e94 req-ba64d1d5-0c81-4ac2-8e90-59e38156256d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058532 Jun 07 09:30:04.416831 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-647dec65-ee32-4829-9979-7e1a7f6153cc tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:04.417880 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 167/335] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Jun 7 09:30:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:30:04.419038 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-647dec65-ee32-4829-9979-7e1a7f6153cc tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:04.420344 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.objects.instance [None req-647dec65-ee32-4829-9979-7e1a7f6153cc tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lazy-loading 'fault' on Instance uuid 90803094-e09d-4c65-9aba-88d612d0dafd {{(pid=118741) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 09:30:04.465944 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-e9dcc333-5604-414b-85ec-1e16a16c4b34 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:30:04.466884 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-e9dcc333-5604-414b-85ec-1e16a16c4b34 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:30:04.475143 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-647dec65-ee32-4829-9979-7e1a7f6153cc tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9726e11bda974054a1e972c097b1ea1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986f0a9e430e4caaaed4affc2d4b8aeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:30:04.475310 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-e9dcc333-5604-414b-85ec-1e16a16c4b34 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:04.475901 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-e9dcc333-5604-414b-85ec-1e16a16c4b34 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:04.476796 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-e9dcc333-5604-414b-85ec-1e16a16c4b34 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:04.477243 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-e9dcc333-5604-414b-85ec-1e16a16c4b34 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:04.486662 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-647dec65-ee32-4829-9979-7e1a7f6153cc tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] 10.222.0.57 "GET /compute/v2.1/servers/90803094-e09d-4c65-9aba-88d612d0dafd" status: 200 len: 1350 microversion: 2.1 time: 0.131511 Jun 07 09:30:04.487595 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 169/336] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:30:04 2022] GET /compute/v2.1/servers/90803094-e09d-4c65-9aba-88d612d0dafd => generated 1350 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:30:04.616217 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-4a05322f-bd7d-4762-beb1-1325377edde6 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:30:04.621962 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-4a05322f-bd7d-4762-beb1-1325377edde6 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] [instance: 6644ea64-dd17-4874-b6ed-9a19b951a3a3] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:30:04.632721 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-4a05322f-bd7d-4762-beb1-1325377edde6 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:04.633392 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-4a05322f-bd7d-4762-beb1-1325377edde6 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:04.634354 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-4a05322f-bd7d-4762-beb1-1325377edde6 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:04.634987 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-4a05322f-bd7d-4762-beb1-1325377edde6 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:04.659494 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-e9dcc333-5604-414b-85ec-1e16a16c4b34 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:30:04.668396 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-e9dcc333-5604-414b-85ec-1e16a16c4b34 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4" status: 200 len: 1521 microversion: 2.1 time: 0.208846 Jun 07 09:30:04.676907 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 168/337] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:30:04 2022] GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4 => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:30:04.793123 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-4a05322f-bd7d-4762-beb1-1325377edde6 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e44a60fc7244d6d88a20aeac53c3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44089f44ea384df88ea8e9411dc94476', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:30:04.801051 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-4a05322f-bd7d-4762-beb1-1325377edde6 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] 10.222.0.57 "GET /compute/v2.1/servers/6644ea64-dd17-4874-b6ed-9a19b951a3a3" status: 200 len: 1315 microversion: 2.1 time: 0.190310 Jun 07 09:30:04.806147 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 170/338] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:30:04 2022] GET /compute/v2.1/servers/6644ea64-dd17-4874-b6ed-9a19b951a3a3 => generated 1315 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:30:05.506527 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-6ecbe146-5073-44c0-a85b-6e63b43b0654 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:30:05.507142 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-6ecbe146-5073-44c0-a85b-6e63b43b0654 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] [instance: 90803094-e09d-4c65-9aba-88d612d0dafd] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:30:05.514361 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-6ecbe146-5073-44c0-a85b-6e63b43b0654 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:05.514808 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-6ecbe146-5073-44c0-a85b-6e63b43b0654 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:05.515572 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-6ecbe146-5073-44c0-a85b-6e63b43b0654 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:05.516013 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-6ecbe146-5073-44c0-a85b-6e63b43b0654 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:05.531537 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.wsgi [None req-6ecbe146-5073-44c0-a85b-6e63b43b0654 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] HTTP exception thrown: Instance 90803094-e09d-4c65-9aba-88d612d0dafd could not be found. Jun 07 09:30:05.537062 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-6ecbe146-5073-44c0-a85b-6e63b43b0654 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Request method failure captured: Jun 07 09:30:05.537062 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: request: GET /compute/v2.1/servers/90803094-e09d-4c65-9aba-88d612d0dafd HTTP/1.1 Jun 07 09:30:05.537062 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Accept: application/json Jun 07 09:30:05.537062 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Accept-Encoding: identity Jun 07 09:30:05.537062 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Connection: close Jun 07 09:30:05.537062 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Content-Length: 0 Jun 07 09:30:05.537062 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Content-Type: application/json Jun 07 09:30:05.537062 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Host: 10.222.0.57 Jun 07 09:30:05.537062 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Openstack-System-Scope: None Jun 07 09:30:05.537062 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: User-Agent: python-urllib3/1.26.9 Jun 07 09:30:05.537062 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Auth-Token: gAAAAABinxo1QJ2CddzcFVB9_ZELxln1HGnn6tnKJVizBo8KhZgNnufduOsAgVyxa-R_BqZvfvKwYrI1g7qVbNsDu6CITwJB5TDPVoPZCinRuwojTh5n9SPCxzMpbjNZ53UaQa5Bkxvqnxlm_POPqm-07T4lNXncbhOcWcI0ugCx7d1t_sfDFBU Jun 07 09:30:05.537062 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Domain-Id: None Jun 07 09:30:05.537062 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Domain-Name: None Jun 07 09:30:05.537062 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Identity-Status: Confirmed Jun 07 09:30:05.537062 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Is-Admin-Project: True Jun 07 09:30:05.537062 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Domain-Id: default Jun 07 09:30:05.537062 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Domain-Name: Default Jun 07 09:30:05.537062 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Id: 986f0a9e430e4caaaed4affc2d4b8aeb Jun 07 09:30:05.537062 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Name: tempest-DeleteServersTestJSON-214594728 Jun 07 09:30:05.537062 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Role: reader,member Jun 07 09:30:05.537062 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Roles: reader,member Jun 07 09:30:05.538341 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/986f0a9e430e4caaaed4affc2d4b8aeb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/986f0a9e430e4caaaed4affc2d4b8aeb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_986f0a9e430e4caaaed4affc2d4b8aeb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/986f0a9e430e4caaaed4affc2d4b8aeb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 07 09:30:05.538341 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Tenant: tempest-DeleteServersTestJSON-214594728 Jun 07 09:30:05.538341 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Tenant-Id: 986f0a9e430e4caaaed4affc2d4b8aeb Jun 07 09:30:05.538341 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Tenant-Name: tempest-DeleteServersTestJSON-214594728 Jun 07 09:30:05.538341 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User: tempest-DeleteServersTestJSON-214594728-project Jun 07 09:30:05.538341 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Domain-Id: default Jun 07 09:30:05.538341 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Domain-Name: Default Jun 07 09:30:05.538341 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Id: 9726e11bda974054a1e972c097b1ea1d Jun 07 09:30:05.538341 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Name: tempest-DeleteServersTestJSON-214594728-project Jun 07 09:30:05.538341 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: method: > Jun 07 09:30:05.538341 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: exception: Instance 90803094-e09d-4c65-9aba-88d612d0dafd could not be found. Jun 07 09:30:05.538341 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: action_args: {'id': '90803094-e09d-4c65-9aba-88d612d0dafd'} Jun 07 09:30:05.539132 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 09:30:05.539132 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:30:05.539132 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 09:30:05.539132 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 09:30:05.539132 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 09:30:05.539132 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 09:30:05.539132 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 09:30:05.539132 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 09:30:05.539132 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 09:30:05.539132 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 09:30:05.539132 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90803094-e09d-4c65-9aba-88d612d0dafd could not be found. Jun 07 09:30:05.539132 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:30:05.539132 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:30:05.539132 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:30:05.539132 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:30:05.539132 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:30:05.539132 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:30:05.539132 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 09:30:05.539132 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 09:30:05.539132 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 09:30:05.540622 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 09:30:05.540622 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 09:30:05.540622 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 09:30:05.540622 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 09:30:05.540622 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 09:30:05.540622 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 09:30:05.540622 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 09:30:05.540622 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90803094-e09d-4c65-9aba-88d612d0dafd could not be found. Jun 07 09:30:05.540622 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:30:05.540622 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:30:05.540622 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:30:05.540622 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:30:05.540622 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:30:05.540622 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:30:05.540622 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 09:30:05.540622 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 09:30:05.540622 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90803094-e09d-4c65-9aba-88d612d0dafd could not be found. Jun 07 09:30:05.540622 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:30:05.541752 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-6ecbe146-5073-44c0-a85b-6e63b43b0654 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Returning 404 to user: Instance 90803094-e09d-4c65-9aba-88d612d0dafd could not be found. {{(pid=118740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 09:30:05.541752 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-6ecbe146-5073-44c0-a85b-6e63b43b0654 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] 10.222.0.57 "GET /compute/v2.1/servers/90803094-e09d-4c65-9aba-88d612d0dafd" status: 404 len: 111 microversion: 2.1 time: 0.036321 Jun 07 09:30:05.543096 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 169/339] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:30:05 2022] GET /compute/v2.1/servers/90803094-e09d-4c65-9aba-88d612d0dafd => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 09:30:05.652910 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-be2468a6-82a7-4d14-a7ec-0fd2396f28af tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:30:05.653897 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-be2468a6-82a7-4d14-a7ec-0fd2396f28af tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] [instance: 90803094-e09d-4c65-9aba-88d612d0dafd] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:30:05.660147 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-be2468a6-82a7-4d14-a7ec-0fd2396f28af tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:05.660619 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-be2468a6-82a7-4d14-a7ec-0fd2396f28af tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:05.661376 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-be2468a6-82a7-4d14-a7ec-0fd2396f28af tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:05.661812 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-be2468a6-82a7-4d14-a7ec-0fd2396f28af tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:05.674947 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.wsgi [None req-be2468a6-82a7-4d14-a7ec-0fd2396f28af tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] HTTP exception thrown: Instance 90803094-e09d-4c65-9aba-88d612d0dafd could not be found. Jun 07 09:30:05.679386 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-be2468a6-82a7-4d14-a7ec-0fd2396f28af tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Request method failure captured: Jun 07 09:30:05.679386 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: request: GET /compute/v2.1/servers/90803094-e09d-4c65-9aba-88d612d0dafd/os-volume_attachments HTTP/1.1 Jun 07 09:30:05.679386 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Accept: application/json Jun 07 09:30:05.679386 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Accept-Encoding: identity Jun 07 09:30:05.679386 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Connection: close Jun 07 09:30:05.679386 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Content-Length: 0 Jun 07 09:30:05.679386 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Content-Type: application/json Jun 07 09:30:05.679386 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Host: 10.222.0.57 Jun 07 09:30:05.679386 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Openstack-System-Scope: None Jun 07 09:30:05.679386 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: User-Agent: python-urllib3/1.26.9 Jun 07 09:30:05.679386 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Auth-Token: gAAAAABinxo1QJ2CddzcFVB9_ZELxln1HGnn6tnKJVizBo8KhZgNnufduOsAgVyxa-R_BqZvfvKwYrI1g7qVbNsDu6CITwJB5TDPVoPZCinRuwojTh5n9SPCxzMpbjNZ53UaQa5Bkxvqnxlm_POPqm-07T4lNXncbhOcWcI0ugCx7d1t_sfDFBU Jun 07 09:30:05.679386 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Domain-Id: None Jun 07 09:30:05.679386 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Domain-Name: None Jun 07 09:30:05.679386 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Identity-Status: Confirmed Jun 07 09:30:05.679386 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Is-Admin-Project: True Jun 07 09:30:05.679386 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Project-Domain-Id: default Jun 07 09:30:05.679386 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Project-Domain-Name: Default Jun 07 09:30:05.679386 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Project-Id: 986f0a9e430e4caaaed4affc2d4b8aeb Jun 07 09:30:05.679386 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Project-Name: tempest-DeleteServersTestJSON-214594728 Jun 07 09:30:05.679386 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Role: reader,member Jun 07 09:30:05.679386 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Roles: reader,member Jun 07 09:30:05.680756 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/986f0a9e430e4caaaed4affc2d4b8aeb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/986f0a9e430e4caaaed4affc2d4b8aeb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_986f0a9e430e4caaaed4affc2d4b8aeb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/986f0a9e430e4caaaed4affc2d4b8aeb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 07 09:30:05.680756 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Tenant: tempest-DeleteServersTestJSON-214594728 Jun 07 09:30:05.680756 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Tenant-Id: 986f0a9e430e4caaaed4affc2d4b8aeb Jun 07 09:30:05.680756 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Tenant-Name: tempest-DeleteServersTestJSON-214594728 Jun 07 09:30:05.680756 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User: tempest-DeleteServersTestJSON-214594728-project Jun 07 09:30:05.680756 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User-Domain-Id: default Jun 07 09:30:05.680756 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User-Domain-Name: Default Jun 07 09:30:05.680756 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User-Id: 9726e11bda974054a1e972c097b1ea1d Jun 07 09:30:05.680756 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User-Name: tempest-DeleteServersTestJSON-214594728-project Jun 07 09:30:05.680756 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: method: > Jun 07 09:30:05.680756 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: exception: Instance 90803094-e09d-4c65-9aba-88d612d0dafd could not be found. Jun 07 09:30:05.680756 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: action_args: {'server_id': '90803094-e09d-4c65-9aba-88d612d0dafd'} Jun 07 09:30:05.681417 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 09:30:05.681417 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:30:05.681417 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 09:30:05.681417 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 09:30:05.681417 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 09:30:05.681417 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 09:30:05.681417 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 09:30:05.681417 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 09:30:05.681417 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 09:30:05.681417 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 09:30:05.681417 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90803094-e09d-4c65-9aba-88d612d0dafd could not be found. Jun 07 09:30:05.681417 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:30:05.681417 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:30:05.681417 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:30:05.681417 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:30:05.681417 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:30:05.681417 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:30:05.681417 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 09:30:05.681417 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 09:30:05.681417 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 09:30:05.682462 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 09:30:05.682462 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 07 09:30:05.682462 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 09:30:05.682462 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 07 09:30:05.682462 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 09:30:05.682462 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 07 09:30:05.682462 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 07 09:30:05.682462 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 09:30:05.682462 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 09:30:05.682462 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90803094-e09d-4c65-9aba-88d612d0dafd could not be found. Jun 07 09:30:05.682462 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:30:05.682462 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:30:05.682462 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:30:05.682462 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:30:05.682462 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:30:05.682462 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:30:05.682462 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 09:30:05.682462 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 09:30:05.682462 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90803094-e09d-4c65-9aba-88d612d0dafd could not be found. Jun 07 09:30:05.682462 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:30:05.683555 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-be2468a6-82a7-4d14-a7ec-0fd2396f28af tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Returning 404 to user: Instance 90803094-e09d-4c65-9aba-88d612d0dafd could not be found. {{(pid=118741) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 09:30:05.683555 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-be2468a6-82a7-4d14-a7ec-0fd2396f28af tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] 10.222.0.57 "GET /compute/v2.1/servers/90803094-e09d-4c65-9aba-88d612d0dafd/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032787 Jun 07 09:30:05.685124 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 171/340] 10.222.0.57 () {58 vars in 1301 bytes} [Tue Jun 7 09:30:05 2022] GET /compute/v2.1/servers/90803094-e09d-4c65-9aba-88d612d0dafd/os-volume_attachments => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 09:30:05.685576 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-f6b0ff41-1628-4b08-bc31-954d635fe9c1 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:30:05.686250 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-f6b0ff41-1628-4b08-bc31-954d635fe9c1 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:30:05.692555 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-f6b0ff41-1628-4b08-bc31-954d635fe9c1 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:05.693074 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-f6b0ff41-1628-4b08-bc31-954d635fe9c1 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:05.694075 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-f6b0ff41-1628-4b08-bc31-954d635fe9c1 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:05.694521 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-f6b0ff41-1628-4b08-bc31-954d635fe9c1 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:05.827868 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-56320675-dd8f-4343-8e50-dae85d774cc2 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:30:05.830505 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-56320675-dd8f-4343-8e50-dae85d774cc2 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] [instance: 6644ea64-dd17-4874-b6ed-9a19b951a3a3] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:30:05.837021 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-56320675-dd8f-4343-8e50-dae85d774cc2 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:05.837472 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-56320675-dd8f-4343-8e50-dae85d774cc2 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:05.838410 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-56320675-dd8f-4343-8e50-dae85d774cc2 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:05.847524 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-f6b0ff41-1628-4b08-bc31-954d635fe9c1 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:30:05.848174 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-56320675-dd8f-4343-8e50-dae85d774cc2 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:05.854414 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-f6b0ff41-1628-4b08-bc31-954d635fe9c1 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4" status: 200 len: 1521 microversion: 2.1 time: 0.173467 Jun 07 09:30:05.854985 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 170/341] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:30:05 2022] GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:30:05.983337 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-56320675-dd8f-4343-8e50-dae85d774cc2 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e44a60fc7244d6d88a20aeac53c3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44089f44ea384df88ea8e9411dc94476', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:30:05.990829 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-56320675-dd8f-4343-8e50-dae85d774cc2 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] 10.222.0.57 "GET /compute/v2.1/servers/6644ea64-dd17-4874-b6ed-9a19b951a3a3" status: 200 len: 1315 microversion: 2.1 time: 0.169609 Jun 07 09:30:05.991383 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 172/342] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:30:05 2022] GET /compute/v2.1/servers/6644ea64-dd17-4874-b6ed-9a19b951a3a3 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:30:06.872780 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-0b33e234-c5c4-470f-8f3f-81958d60a902 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:30:06.872780 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-0b33e234-c5c4-470f-8f3f-81958d60a902 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:30:06.874346 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writing DB stats nova_cell0:SELECT=2 {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:30:06.879215 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-0b33e234-c5c4-470f-8f3f-81958d60a902 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:06.879663 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-0b33e234-c5c4-470f-8f3f-81958d60a902 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:06.880453 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-0b33e234-c5c4-470f-8f3f-81958d60a902 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:06.880963 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-0b33e234-c5c4-470f-8f3f-81958d60a902 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:07.009974 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-d95acb44-04fe-4231-8717-47dae22c0ad3 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:30:07.012380 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-d95acb44-04fe-4231-8717-47dae22c0ad3 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] [instance: 6644ea64-dd17-4874-b6ed-9a19b951a3a3] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:30:07.014781 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writing DB stats nova_cell0:SELECT=2 {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:30:07.015629 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-0b33e234-c5c4-470f-8f3f-81958d60a902 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:30:07.026320 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-d95acb44-04fe-4231-8717-47dae22c0ad3 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:07.028093 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-d95acb44-04fe-4231-8717-47dae22c0ad3 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:07.029443 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-d95acb44-04fe-4231-8717-47dae22c0ad3 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:07.030178 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-d95acb44-04fe-4231-8717-47dae22c0ad3 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:07.043157 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-0b33e234-c5c4-470f-8f3f-81958d60a902 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4" status: 200 len: 1521 microversion: 2.1 time: 0.166471 Jun 07 09:30:07.043157 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 171/343] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:30:06 2022] GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:30:07.169946 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-d95acb44-04fe-4231-8717-47dae22c0ad3 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e44a60fc7244d6d88a20aeac53c3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44089f44ea384df88ea8e9411dc94476', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:30:07.177705 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-d95acb44-04fe-4231-8717-47dae22c0ad3 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] 10.222.0.57 "GET /compute/v2.1/servers/6644ea64-dd17-4874-b6ed-9a19b951a3a3" status: 200 len: 1315 microversion: 2.1 time: 0.174294 Jun 07 09:30:07.178260 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 173/344] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:30:07 2022] GET /compute/v2.1/servers/6644ea64-dd17-4874-b6ed-9a19b951a3a3 => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:30:07.266597 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-9d86e459-449f-43bb-ac75-0f7deb63a50c tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:30:07.267191 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-9d86e459-449f-43bb-ac75-0f7deb63a50c tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] [instance: 90803094-e09d-4c65-9aba-88d612d0dafd] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:30:07.273717 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-9d86e459-449f-43bb-ac75-0f7deb63a50c tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:07.274658 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-9d86e459-449f-43bb-ac75-0f7deb63a50c tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:07.275814 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-9d86e459-449f-43bb-ac75-0f7deb63a50c tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:07.275975 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-9d86e459-449f-43bb-ac75-0f7deb63a50c tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:07.290074 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.wsgi [None req-9d86e459-449f-43bb-ac75-0f7deb63a50c tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] HTTP exception thrown: Instance 90803094-e09d-4c65-9aba-88d612d0dafd could not be found. Jun 07 09:30:07.291625 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-9d86e459-449f-43bb-ac75-0f7deb63a50c tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Request method failure captured: Jun 07 09:30:07.291625 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: request: DELETE /compute/v2.1/servers/90803094-e09d-4c65-9aba-88d612d0dafd HTTP/1.1 Jun 07 09:30:07.291625 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Accept: application/json Jun 07 09:30:07.291625 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Accept-Encoding: identity Jun 07 09:30:07.291625 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Connection: close Jun 07 09:30:07.291625 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Content-Length: 0 Jun 07 09:30:07.291625 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Content-Type: application/json Jun 07 09:30:07.291625 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Host: 10.222.0.57 Jun 07 09:30:07.291625 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Openstack-System-Scope: None Jun 07 09:30:07.291625 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: User-Agent: python-urllib3/1.26.9 Jun 07 09:30:07.291625 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Auth-Token: gAAAAABinxo1QJ2CddzcFVB9_ZELxln1HGnn6tnKJVizBo8KhZgNnufduOsAgVyxa-R_BqZvfvKwYrI1g7qVbNsDu6CITwJB5TDPVoPZCinRuwojTh5n9SPCxzMpbjNZ53UaQa5Bkxvqnxlm_POPqm-07T4lNXncbhOcWcI0ugCx7d1t_sfDFBU Jun 07 09:30:07.291625 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Domain-Id: None Jun 07 09:30:07.291625 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Domain-Name: None Jun 07 09:30:07.291625 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Identity-Status: Confirmed Jun 07 09:30:07.291625 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Is-Admin-Project: True Jun 07 09:30:07.291625 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Domain-Id: default Jun 07 09:30:07.291625 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Domain-Name: Default Jun 07 09:30:07.291625 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Id: 986f0a9e430e4caaaed4affc2d4b8aeb Jun 07 09:30:07.291625 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Name: tempest-DeleteServersTestJSON-214594728 Jun 07 09:30:07.291625 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Role: reader,member Jun 07 09:30:07.291625 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Roles: reader,member Jun 07 09:30:07.293645 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/986f0a9e430e4caaaed4affc2d4b8aeb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/986f0a9e430e4caaaed4affc2d4b8aeb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_986f0a9e430e4caaaed4affc2d4b8aeb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/986f0a9e430e4caaaed4affc2d4b8aeb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 07 09:30:07.293645 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Tenant: tempest-DeleteServersTestJSON-214594728 Jun 07 09:30:07.293645 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Tenant-Id: 986f0a9e430e4caaaed4affc2d4b8aeb Jun 07 09:30:07.293645 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Tenant-Name: tempest-DeleteServersTestJSON-214594728 Jun 07 09:30:07.293645 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User: tempest-DeleteServersTestJSON-214594728-project Jun 07 09:30:07.293645 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Domain-Id: default Jun 07 09:30:07.293645 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Domain-Name: Default Jun 07 09:30:07.293645 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Id: 9726e11bda974054a1e972c097b1ea1d Jun 07 09:30:07.293645 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Name: tempest-DeleteServersTestJSON-214594728-project Jun 07 09:30:07.293645 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: method: > Jun 07 09:30:07.293645 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: exception: Instance 90803094-e09d-4c65-9aba-88d612d0dafd could not be found. Jun 07 09:30:07.293645 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: action_args: {'id': '90803094-e09d-4c65-9aba-88d612d0dafd'} Jun 07 09:30:07.294404 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 09:30:07.294404 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:30:07.294404 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 09:30:07.294404 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 09:30:07.294404 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 09:30:07.294404 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 09:30:07.294404 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 09:30:07.294404 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 09:30:07.294404 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 09:30:07.294404 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 09:30:07.294404 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90803094-e09d-4c65-9aba-88d612d0dafd could not be found. Jun 07 09:30:07.294404 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:30:07.294404 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:30:07.294404 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:30:07.294404 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:30:07.294404 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:30:07.294404 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:30:07.294404 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 09:30:07.294404 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 09:30:07.294404 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 09:30:07.295774 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 09:30:07.295774 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 07 09:30:07.295774 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 07 09:30:07.295774 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 07 09:30:07.295774 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 07 09:30:07.295774 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 09:30:07.295774 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 09:30:07.295774 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 09:30:07.295774 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 09:30:07.295774 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90803094-e09d-4c65-9aba-88d612d0dafd could not be found. Jun 07 09:30:07.295774 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:30:07.295774 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:30:07.295774 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:30:07.295774 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:30:07.295774 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:30:07.295774 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:30:07.295774 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 09:30:07.295774 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 09:30:07.295774 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90803094-e09d-4c65-9aba-88d612d0dafd could not be found. Jun 07 09:30:07.295774 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:30:07.297112 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-9d86e459-449f-43bb-ac75-0f7deb63a50c tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Returning 404 to user: Instance 90803094-e09d-4c65-9aba-88d612d0dafd could not be found. {{(pid=118740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 09:30:07.297112 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-9d86e459-449f-43bb-ac75-0f7deb63a50c tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] 10.222.0.57 "DELETE /compute/v2.1/servers/90803094-e09d-4c65-9aba-88d612d0dafd" status: 404 len: 111 microversion: 2.1 time: 0.030666 Jun 07 09:30:07.297112 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 172/345] 10.222.0.57 () {58 vars in 1238 bytes} [Tue Jun 7 09:30:07 2022] DELETE /compute/v2.1/servers/90803094-e09d-4c65-9aba-88d612d0dafd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 09:30:07.302438 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-7f4ebe99-e595-486f-9d7a-5377210464e2 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:30:07.303122 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-7f4ebe99-e595-486f-9d7a-5377210464e2 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] [instance: 90803094-e09d-4c65-9aba-88d612d0dafd] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:30:07.309230 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-7f4ebe99-e595-486f-9d7a-5377210464e2 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:07.309750 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-7f4ebe99-e595-486f-9d7a-5377210464e2 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:07.310686 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-7f4ebe99-e595-486f-9d7a-5377210464e2 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:07.311180 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-7f4ebe99-e595-486f-9d7a-5377210464e2 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:07.324910 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.wsgi [None req-7f4ebe99-e595-486f-9d7a-5377210464e2 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] HTTP exception thrown: Instance 90803094-e09d-4c65-9aba-88d612d0dafd could not be found. Jun 07 09:30:07.327242 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-7f4ebe99-e595-486f-9d7a-5377210464e2 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Request method failure captured: Jun 07 09:30:07.327242 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: request: GET /compute/v2.1/servers/90803094-e09d-4c65-9aba-88d612d0dafd HTTP/1.1 Jun 07 09:30:07.327242 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Accept: application/json Jun 07 09:30:07.327242 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Accept-Encoding: identity Jun 07 09:30:07.327242 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Connection: close Jun 07 09:30:07.327242 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Content-Length: 0 Jun 07 09:30:07.327242 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Content-Type: application/json Jun 07 09:30:07.327242 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Host: 10.222.0.57 Jun 07 09:30:07.327242 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Openstack-System-Scope: None Jun 07 09:30:07.327242 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: User-Agent: python-urllib3/1.26.9 Jun 07 09:30:07.327242 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Auth-Token: gAAAAABinxo1QJ2CddzcFVB9_ZELxln1HGnn6tnKJVizBo8KhZgNnufduOsAgVyxa-R_BqZvfvKwYrI1g7qVbNsDu6CITwJB5TDPVoPZCinRuwojTh5n9SPCxzMpbjNZ53UaQa5Bkxvqnxlm_POPqm-07T4lNXncbhOcWcI0ugCx7d1t_sfDFBU Jun 07 09:30:07.327242 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Domain-Id: None Jun 07 09:30:07.327242 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Domain-Name: None Jun 07 09:30:07.327242 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Identity-Status: Confirmed Jun 07 09:30:07.327242 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Is-Admin-Project: True Jun 07 09:30:07.327242 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Project-Domain-Id: default Jun 07 09:30:07.327242 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Project-Domain-Name: Default Jun 07 09:30:07.327242 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Project-Id: 986f0a9e430e4caaaed4affc2d4b8aeb Jun 07 09:30:07.327242 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Project-Name: tempest-DeleteServersTestJSON-214594728 Jun 07 09:30:07.327242 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Role: reader,member Jun 07 09:30:07.327242 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Roles: reader,member Jun 07 09:30:07.328607 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/986f0a9e430e4caaaed4affc2d4b8aeb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/986f0a9e430e4caaaed4affc2d4b8aeb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_986f0a9e430e4caaaed4affc2d4b8aeb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/986f0a9e430e4caaaed4affc2d4b8aeb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 07 09:30:07.328607 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Tenant: tempest-DeleteServersTestJSON-214594728 Jun 07 09:30:07.328607 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Tenant-Id: 986f0a9e430e4caaaed4affc2d4b8aeb Jun 07 09:30:07.328607 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Tenant-Name: tempest-DeleteServersTestJSON-214594728 Jun 07 09:30:07.328607 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User: tempest-DeleteServersTestJSON-214594728-project Jun 07 09:30:07.328607 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User-Domain-Id: default Jun 07 09:30:07.328607 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User-Domain-Name: Default Jun 07 09:30:07.328607 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User-Id: 9726e11bda974054a1e972c097b1ea1d Jun 07 09:30:07.328607 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User-Name: tempest-DeleteServersTestJSON-214594728-project Jun 07 09:30:07.328607 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: method: > Jun 07 09:30:07.328607 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: exception: Instance 90803094-e09d-4c65-9aba-88d612d0dafd could not be found. Jun 07 09:30:07.328607 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: action_args: {'id': '90803094-e09d-4c65-9aba-88d612d0dafd'} Jun 07 09:30:07.329392 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 09:30:07.329392 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:30:07.329392 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 09:30:07.329392 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 09:30:07.329392 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 09:30:07.329392 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 09:30:07.329392 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 09:30:07.329392 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 09:30:07.329392 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 09:30:07.329392 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 09:30:07.329392 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90803094-e09d-4c65-9aba-88d612d0dafd could not be found. Jun 07 09:30:07.329392 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:30:07.329392 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:30:07.329392 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:30:07.329392 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:30:07.329392 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:30:07.329392 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:30:07.329392 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 09:30:07.329392 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 09:30:07.329392 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 09:30:07.330670 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 09:30:07.330670 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 09:30:07.330670 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 09:30:07.330670 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 09:30:07.330670 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 09:30:07.330670 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 09:30:07.330670 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 09:30:07.330670 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90803094-e09d-4c65-9aba-88d612d0dafd could not be found. Jun 07 09:30:07.330670 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:30:07.330670 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:30:07.330670 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:30:07.330670 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:30:07.330670 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:30:07.330670 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:30:07.330670 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 09:30:07.330670 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 09:30:07.330670 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90803094-e09d-4c65-9aba-88d612d0dafd could not be found. Jun 07 09:30:07.330670 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:30:07.331852 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-7f4ebe99-e595-486f-9d7a-5377210464e2 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] Returning 404 to user: Instance 90803094-e09d-4c65-9aba-88d612d0dafd could not be found. {{(pid=118741) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 09:30:07.331852 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-7f4ebe99-e595-486f-9d7a-5377210464e2 tempest-DeleteServersTestJSON-214594728 tempest-DeleteServersTestJSON-214594728-project] 10.222.0.57 "GET /compute/v2.1/servers/90803094-e09d-4c65-9aba-88d612d0dafd" status: 404 len: 111 microversion: 2.1 time: 0.030097 Jun 07 09:30:07.331852 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 174/346] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:30:07 2022] GET /compute/v2.1/servers/90803094-e09d-4c65-9aba-88d612d0dafd => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 09:30:08.057815 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-cc94067a-f617-49f9-a0b0-3ed9024f4c27 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:30:08.059315 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-cc94067a-f617-49f9-a0b0-3ed9024f4c27 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:30:08.065879 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-cc94067a-f617-49f9-a0b0-3ed9024f4c27 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:08.066348 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-cc94067a-f617-49f9-a0b0-3ed9024f4c27 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:08.067336 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-cc94067a-f617-49f9-a0b0-3ed9024f4c27 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:08.067997 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-cc94067a-f617-49f9-a0b0-3ed9024f4c27 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:08.194346 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-c7231f22-6966-4484-8abd-95411517cd1a tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:30:08.194927 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-c7231f22-6966-4484-8abd-95411517cd1a tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] [instance: 6644ea64-dd17-4874-b6ed-9a19b951a3a3] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:30:08.196994 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writing DB stats nova_cell0:SELECT=8 {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:30:08.202862 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-c7231f22-6966-4484-8abd-95411517cd1a tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:08.203538 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-c7231f22-6966-4484-8abd-95411517cd1a tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:08.204838 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-c7231f22-6966-4484-8abd-95411517cd1a tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:08.205271 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-c7231f22-6966-4484-8abd-95411517cd1a tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:08.268246 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-cc94067a-f617-49f9-a0b0-3ed9024f4c27 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:30:08.278534 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-cc94067a-f617-49f9-a0b0-3ed9024f4c27 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4" status: 200 len: 1521 microversion: 2.1 time: 0.224482 Jun 07 09:30:08.287912 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 173/347] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:30:08 2022] GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4 => generated 1521 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:30:08.374059 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-c7231f22-6966-4484-8abd-95411517cd1a tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e44a60fc7244d6d88a20aeac53c3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44089f44ea384df88ea8e9411dc94476', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:30:08.376652 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:30:08.382699 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-c7231f22-6966-4484-8abd-95411517cd1a tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] 10.222.0.57 "GET /compute/v2.1/servers/6644ea64-dd17-4874-b6ed-9a19b951a3a3" status: 200 len: 1315 microversion: 2.1 time: 0.192093 Jun 07 09:30:08.383344 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 175/348] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:30:08 2022] GET /compute/v2.1/servers/6644ea64-dd17-4874-b6ed-9a19b951a3a3 => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:30:09.295419 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-f72d2b7f-6848-41ed-a8f3-053ec7563ffd tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:30:09.296029 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-f72d2b7f-6848-41ed-a8f3-053ec7563ffd tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:30:09.298573 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writing DB stats nova_api:SELECT=88 {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:30:09.303820 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-f72d2b7f-6848-41ed-a8f3-053ec7563ffd tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:09.304215 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-f72d2b7f-6848-41ed-a8f3-053ec7563ffd tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:09.305012 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-f72d2b7f-6848-41ed-a8f3-053ec7563ffd tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:09.305446 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-f72d2b7f-6848-41ed-a8f3-053ec7563ffd tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:09.401152 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-32c1f49e-8a6f-43e7-86a5-967dab354fa3 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:30:09.402037 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-32c1f49e-8a6f-43e7-86a5-967dab354fa3 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] [instance: 6644ea64-dd17-4874-b6ed-9a19b951a3a3] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:30:09.411935 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-32c1f49e-8a6f-43e7-86a5-967dab354fa3 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:09.413131 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-32c1f49e-8a6f-43e7-86a5-967dab354fa3 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:09.414362 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-32c1f49e-8a6f-43e7-86a5-967dab354fa3 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:09.415049 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-32c1f49e-8a6f-43e7-86a5-967dab354fa3 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:09.460928 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-f72d2b7f-6848-41ed-a8f3-053ec7563ffd tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:30:09.469461 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-f72d2b7f-6848-41ed-a8f3-053ec7563ffd tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4" status: 200 len: 1521 microversion: 2.1 time: 0.177978 Jun 07 09:30:09.470335 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 174/349] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:30:09 2022] GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:30:09.570268 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-32c1f49e-8a6f-43e7-86a5-967dab354fa3 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e44a60fc7244d6d88a20aeac53c3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44089f44ea384df88ea8e9411dc94476', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:30:09.577595 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-32c1f49e-8a6f-43e7-86a5-967dab354fa3 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] 10.222.0.57 "GET /compute/v2.1/servers/6644ea64-dd17-4874-b6ed-9a19b951a3a3" status: 200 len: 1315 microversion: 2.1 time: 0.180645 Jun 07 09:30:09.578159 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 176/350] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:30:09 2022] GET /compute/v2.1/servers/6644ea64-dd17-4874-b6ed-9a19b951a3a3 => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:30:10.487034 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-03becda5-122a-407e-83cc-92eade365378 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:30:10.487801 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-03becda5-122a-407e-83cc-92eade365378 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:30:10.494623 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-03becda5-122a-407e-83cc-92eade365378 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:10.495173 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-03becda5-122a-407e-83cc-92eade365378 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:10.496534 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-03becda5-122a-407e-83cc-92eade365378 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:10.497084 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-03becda5-122a-407e-83cc-92eade365378 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:10.600829 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-21cd32d5-3873-4ebd-9f2d-7c01a928caf3 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:30:10.600829 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-21cd32d5-3873-4ebd-9f2d-7c01a928caf3 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] [instance: 6644ea64-dd17-4874-b6ed-9a19b951a3a3] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:30:10.604138 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-21cd32d5-3873-4ebd-9f2d-7c01a928caf3 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:10.604619 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-21cd32d5-3873-4ebd-9f2d-7c01a928caf3 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:10.606345 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-21cd32d5-3873-4ebd-9f2d-7c01a928caf3 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:10.606810 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-21cd32d5-3873-4ebd-9f2d-7c01a928caf3 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:10.684664 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-03becda5-122a-407e-83cc-92eade365378 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:30:10.694014 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-03becda5-122a-407e-83cc-92eade365378 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4" status: 200 len: 1521 microversion: 2.1 time: 0.211590 Jun 07 09:30:10.703905 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 175/351] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:30:10 2022] GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4 => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:30:10.704809 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [req-afa981e3-3eb7-4c4e-825a-3232c6b6fd41 req-73475d39-0041-475e-a62f-ca959fa177bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6644ea64-dd17-4874-b6ed-9a19b951a3a3", "name": "network-vif-plugged", "status": "completed", "tag": "70ed00d8-0269-4fd7-95ad-a77218f83e0d"}]} {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:30:10.718758 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [req-afa981e3-3eb7-4c4e-825a-3232c6b6fd41 req-73475d39-0041-475e-a62f-ca959fa177bf service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:10.723434 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [req-afa981e3-3eb7-4c4e-825a-3232c6b6fd41 req-73475d39-0041-475e-a62f-ca959fa177bf service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:10.732289 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.compute.server_external_events [req-afa981e3-3eb7-4c4e-825a-3232c6b6fd41 req-73475d39-0041-475e-a62f-ca959fa177bf service nova] Creating event network-vif-plugged:70ed00d8-0269-4fd7-95ad-a77218f83e0d for instance 6644ea64-dd17-4874-b6ed-9a19b951a3a3 on hv-cinder-83699 Jun 07 09:30:10.738492 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [req-afa981e3-3eb7-4c4e-825a-3232c6b6fd41 req-73475d39-0041-475e-a62f-ca959fa177bf service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038009 Jun 07 09:30:10.739091 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 176/352] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Jun 7 09:30:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:30:10.763903 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-21cd32d5-3873-4ebd-9f2d-7c01a928caf3 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e44a60fc7244d6d88a20aeac53c3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44089f44ea384df88ea8e9411dc94476', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:30:10.770930 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-21cd32d5-3873-4ebd-9f2d-7c01a928caf3 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] 10.222.0.57 "GET /compute/v2.1/servers/6644ea64-dd17-4874-b6ed-9a19b951a3a3" status: 200 len: 1315 microversion: 2.1 time: 0.179818 Jun 07 09:30:10.771494 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 177/353] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:30:10 2022] GET /compute/v2.1/servers/6644ea64-dd17-4874-b6ed-9a19b951a3a3 => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:30:11.712436 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-2f2fefe8-d35b-4fc1-9307-32fcfb4f499e tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:30:11.713182 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-2f2fefe8-d35b-4fc1-9307-32fcfb4f499e tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:30:11.719276 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-2f2fefe8-d35b-4fc1-9307-32fcfb4f499e tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:11.719720 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-2f2fefe8-d35b-4fc1-9307-32fcfb4f499e tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:11.720479 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-2f2fefe8-d35b-4fc1-9307-32fcfb4f499e tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:11.720940 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-2f2fefe8-d35b-4fc1-9307-32fcfb4f499e tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:11.788992 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-44d4f880-e552-4c93-8cd8-bf9ca7950753 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:30:11.789601 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-44d4f880-e552-4c93-8cd8-bf9ca7950753 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] [instance: 6644ea64-dd17-4874-b6ed-9a19b951a3a3] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:30:11.796630 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-44d4f880-e552-4c93-8cd8-bf9ca7950753 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:11.797088 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-44d4f880-e552-4c93-8cd8-bf9ca7950753 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:11.797847 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-44d4f880-e552-4c93-8cd8-bf9ca7950753 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:11.798924 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-44d4f880-e552-4c93-8cd8-bf9ca7950753 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:11.854422 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-2f2fefe8-d35b-4fc1-9307-32fcfb4f499e tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:30:11.863066 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-2f2fefe8-d35b-4fc1-9307-32fcfb4f499e tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4" status: 200 len: 1521 microversion: 2.1 time: 0.155328 Jun 07 09:30:11.863696 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 177/354] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:30:11 2022] GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:30:11.952215 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-44d4f880-e552-4c93-8cd8-bf9ca7950753 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e44a60fc7244d6d88a20aeac53c3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44089f44ea384df88ea8e9411dc94476', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:30:11.965340 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-44d4f880-e552-4c93-8cd8-bf9ca7950753 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] 10.222.0.57 "GET /compute/v2.1/servers/6644ea64-dd17-4874-b6ed-9a19b951a3a3" status: 200 len: 1315 microversion: 2.1 time: 0.180045 Jun 07 09:30:11.965919 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 178/355] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:30:11 2022] GET /compute/v2.1/servers/6644ea64-dd17-4874-b6ed-9a19b951a3a3 => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:30:12.879076 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-5b24ade7-feca-4b1a-91a8-faa5bb876e54 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:30:12.879736 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-5b24ade7-feca-4b1a-91a8-faa5bb876e54 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:30:12.886131 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-5b24ade7-feca-4b1a-91a8-faa5bb876e54 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:12.887132 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-5b24ade7-feca-4b1a-91a8-faa5bb876e54 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:12.887902 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-5b24ade7-feca-4b1a-91a8-faa5bb876e54 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:12.888480 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-5b24ade7-feca-4b1a-91a8-faa5bb876e54 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:13.024820 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-5b24ade7-feca-4b1a-91a8-faa5bb876e54 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:30:13.032892 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-5b24ade7-feca-4b1a-91a8-faa5bb876e54 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4" status: 200 len: 1521 microversion: 2.1 time: 0.157561 Jun 07 09:30:13.033462 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 178/356] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:30:12 2022] GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:30:13.040713 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-4fa64aa9-5cd6-4063-b229-79d17de10fcb tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:30:13.041388 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-4fa64aa9-5cd6-4063-b229-79d17de10fcb tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] [instance: 6644ea64-dd17-4874-b6ed-9a19b951a3a3] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:30:13.047388 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-4fa64aa9-5cd6-4063-b229-79d17de10fcb tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:13.047830 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-4fa64aa9-5cd6-4063-b229-79d17de10fcb tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:13.048600 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-4fa64aa9-5cd6-4063-b229-79d17de10fcb tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:13.049041 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-4fa64aa9-5cd6-4063-b229-79d17de10fcb tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:13.182873 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-4fa64aa9-5cd6-4063-b229-79d17de10fcb tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e44a60fc7244d6d88a20aeac53c3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44089f44ea384df88ea8e9411dc94476', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:30:13.191120 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-4fa64aa9-5cd6-4063-b229-79d17de10fcb tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] 10.222.0.57 "GET /compute/v2.1/servers/6644ea64-dd17-4874-b6ed-9a19b951a3a3" status: 200 len: 1315 microversion: 2.1 time: 0.154267 Jun 07 09:30:13.191681 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 179/357] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:30:13 2022] GET /compute/v2.1/servers/6644ea64-dd17-4874-b6ed-9a19b951a3a3 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:30:14.048707 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-e4d01a1d-8ce9-49ad-910c-3829948282b6 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:30:14.051467 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-e4d01a1d-8ce9-49ad-910c-3829948282b6 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:30:14.055852 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-e4d01a1d-8ce9-49ad-910c-3829948282b6 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:14.056305 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-e4d01a1d-8ce9-49ad-910c-3829948282b6 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:14.057102 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-e4d01a1d-8ce9-49ad-910c-3829948282b6 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:14.057533 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-e4d01a1d-8ce9-49ad-910c-3829948282b6 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:14.190964 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-e4d01a1d-8ce9-49ad-910c-3829948282b6 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:30:14.198450 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-e4d01a1d-8ce9-49ad-910c-3829948282b6 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4" status: 200 len: 1521 microversion: 2.1 time: 0.153560 Jun 07 09:30:14.199058 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 179/358] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:30:14 2022] GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:30:14.211026 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-c121575e-4c05-4d77-aebe-05edd8a208b8 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:30:14.211638 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-c121575e-4c05-4d77-aebe-05edd8a208b8 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] [instance: 6644ea64-dd17-4874-b6ed-9a19b951a3a3] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:30:14.218158 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-c121575e-4c05-4d77-aebe-05edd8a208b8 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:14.218604 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-c121575e-4c05-4d77-aebe-05edd8a208b8 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:14.219354 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-c121575e-4c05-4d77-aebe-05edd8a208b8 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:14.219785 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-c121575e-4c05-4d77-aebe-05edd8a208b8 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:14.373367 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-c121575e-4c05-4d77-aebe-05edd8a208b8 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e44a60fc7244d6d88a20aeac53c3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44089f44ea384df88ea8e9411dc94476', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:30:14.383621 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-c121575e-4c05-4d77-aebe-05edd8a208b8 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] 10.222.0.57 "GET /compute/v2.1/servers/6644ea64-dd17-4874-b6ed-9a19b951a3a3" status: 200 len: 1464 microversion: 2.1 time: 0.176337 Jun 07 09:30:14.392386 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 180/359] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:30:14 2022] GET /compute/v2.1/servers/6644ea64-dd17-4874-b6ed-9a19b951a3a3 => generated 1464 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:30:14.431525 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-163ddda1-e646-40ee-90e3-5cbdd509c85e tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:30:14.431525 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-163ddda1-e646-40ee-90e3-5cbdd509c85e tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] [instance: 6644ea64-dd17-4874-b6ed-9a19b951a3a3] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:30:14.437621 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-163ddda1-e646-40ee-90e3-5cbdd509c85e tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:14.438076 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-163ddda1-e646-40ee-90e3-5cbdd509c85e tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:14.438847 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-163ddda1-e646-40ee-90e3-5cbdd509c85e tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:14.439287 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-163ddda1-e646-40ee-90e3-5cbdd509c85e tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:14.465321 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-163ddda1-e646-40ee-90e3-5cbdd509c85e tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] [instance: 6644ea64-dd17-4874-b6ed-9a19b951a3a3] Going to try to terminate instance {{(pid=118740) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 09:30:14.852848 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-163ddda1-e646-40ee-90e3-5cbdd509c85e tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] 10.222.0.57 "DELETE /compute/v2.1/servers/6644ea64-dd17-4874-b6ed-9a19b951a3a3" status: 204 len: 0 microversion: 2.1 time: 0.425438 Jun 07 09:30:14.853825 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 180/360] 10.222.0.57 () {58 vars in 1238 bytes} [Tue Jun 7 09:30:14 2022] DELETE /compute/v2.1/servers/6644ea64-dd17-4874-b6ed-9a19b951a3a3 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 09:30:14.862322 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-3dfa0a15-a984-4b3e-9c5f-3c71f1087936 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:30:14.863097 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-3dfa0a15-a984-4b3e-9c5f-3c71f1087936 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] [instance: 6644ea64-dd17-4874-b6ed-9a19b951a3a3] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:30:14.871154 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-3dfa0a15-a984-4b3e-9c5f-3c71f1087936 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:14.871694 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-3dfa0a15-a984-4b3e-9c5f-3c71f1087936 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:14.872535 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-3dfa0a15-a984-4b3e-9c5f-3c71f1087936 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:14.873092 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-3dfa0a15-a984-4b3e-9c5f-3c71f1087936 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:15.055717 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-3dfa0a15-a984-4b3e-9c5f-3c71f1087936 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e44a60fc7244d6d88a20aeac53c3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44089f44ea384df88ea8e9411dc94476', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:30:15.064902 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-3dfa0a15-a984-4b3e-9c5f-3c71f1087936 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] 10.222.0.57 "GET /compute/v2.1/servers/6644ea64-dd17-4874-b6ed-9a19b951a3a3" status: 200 len: 1470 microversion: 2.1 time: 0.206773 Jun 07 09:30:15.065664 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 181/361] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:30:14 2022] GET /compute/v2.1/servers/6644ea64-dd17-4874-b6ed-9a19b951a3a3 => generated 1470 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:30:15.217442 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-0c4cc172-157c-47b5-8175-ac6084b23629 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:30:15.218727 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-0c4cc172-157c-47b5-8175-ac6084b23629 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:30:15.225738 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-0c4cc172-157c-47b5-8175-ac6084b23629 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:15.226496 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-0c4cc172-157c-47b5-8175-ac6084b23629 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:15.227895 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-0c4cc172-157c-47b5-8175-ac6084b23629 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:15.229555 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-0c4cc172-157c-47b5-8175-ac6084b23629 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:15.386334 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-0c4cc172-157c-47b5-8175-ac6084b23629 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:30:15.388842 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:30:15.399077 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-0c4cc172-157c-47b5-8175-ac6084b23629 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4" status: 200 len: 1521 microversion: 2.1 time: 0.184708 Jun 07 09:30:15.400048 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 181/362] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:30:15 2022] GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4 => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:30:16.082047 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-bae9fa4f-3e3f-4b52-91e7-49245e270294 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:30:16.082674 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-bae9fa4f-3e3f-4b52-91e7-49245e270294 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] [instance: 6644ea64-dd17-4874-b6ed-9a19b951a3a3] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:30:16.088636 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-bae9fa4f-3e3f-4b52-91e7-49245e270294 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:16.089081 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-bae9fa4f-3e3f-4b52-91e7-49245e270294 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:16.089818 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-bae9fa4f-3e3f-4b52-91e7-49245e270294 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:16.090243 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-bae9fa4f-3e3f-4b52-91e7-49245e270294 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:16.233222 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-bae9fa4f-3e3f-4b52-91e7-49245e270294 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e44a60fc7244d6d88a20aeac53c3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44089f44ea384df88ea8e9411dc94476', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:30:16.242810 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-bae9fa4f-3e3f-4b52-91e7-49245e270294 tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] 10.222.0.57 "GET /compute/v2.1/servers/6644ea64-dd17-4874-b6ed-9a19b951a3a3" status: 200 len: 1470 microversion: 2.1 time: 0.164153 Jun 07 09:30:16.243609 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 182/363] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:30:16 2022] GET /compute/v2.1/servers/6644ea64-dd17-4874-b6ed-9a19b951a3a3 => generated 1470 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:30:16.416374 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-eddf1105-99cd-4248-9068-7edb519ab95d tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:30:16.417003 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-eddf1105-99cd-4248-9068-7edb519ab95d tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:30:16.424557 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-eddf1105-99cd-4248-9068-7edb519ab95d tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:16.425024 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-eddf1105-99cd-4248-9068-7edb519ab95d tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:16.425775 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-eddf1105-99cd-4248-9068-7edb519ab95d tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:16.426197 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-eddf1105-99cd-4248-9068-7edb519ab95d tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:16.566061 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-eddf1105-99cd-4248-9068-7edb519ab95d tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:30:16.574742 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-eddf1105-99cd-4248-9068-7edb519ab95d tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4" status: 200 len: 1521 microversion: 2.1 time: 0.162504 Jun 07 09:30:16.575312 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 182/364] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:30:16 2022] GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:30:17.263267 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-a7790b36-e470-4974-857d-0f927a52130c tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:30:17.263883 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-a7790b36-e470-4974-857d-0f927a52130c tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] [instance: 6644ea64-dd17-4874-b6ed-9a19b951a3a3] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:30:17.274947 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-a7790b36-e470-4974-857d-0f927a52130c tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:17.275416 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-a7790b36-e470-4974-857d-0f927a52130c tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:17.281191 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-a7790b36-e470-4974-857d-0f927a52130c tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:17.281191 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-a7790b36-e470-4974-857d-0f927a52130c tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:17.471732 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-a7790b36-e470-4974-857d-0f927a52130c tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e44a60fc7244d6d88a20aeac53c3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44089f44ea384df88ea8e9411dc94476', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:30:17.485511 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-a7790b36-e470-4974-857d-0f927a52130c tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] 10.222.0.57 "GET /compute/v2.1/servers/6644ea64-dd17-4874-b6ed-9a19b951a3a3" status: 200 len: 1470 microversion: 2.1 time: 0.221879 Jun 07 09:30:17.485511 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 183/365] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:30:17 2022] GET /compute/v2.1/servers/6644ea64-dd17-4874-b6ed-9a19b951a3a3 => generated 1470 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:30:17.588149 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [req-44355412-e08d-4fb9-b15e-234097e21d14 req-d0143ef7-a925-4f05-ba10-e91e921d699b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6644ea64-dd17-4874-b6ed-9a19b951a3a3", "name": "network-vif-deleted", "tag": "70ed00d8-0269-4fd7-95ad-a77218f83e0d"}]} {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:30:17.591151 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-a7199529-5418-435c-bd02-2fc7e3a89da1 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:30:17.591754 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-a7199529-5418-435c-bd02-2fc7e3a89da1 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:30:17.597889 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-a7199529-5418-435c-bd02-2fc7e3a89da1 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:17.598587 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-a7199529-5418-435c-bd02-2fc7e3a89da1 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:17.599351 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-a7199529-5418-435c-bd02-2fc7e3a89da1 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:17.599946 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-a7199529-5418-435c-bd02-2fc7e3a89da1 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:17.608140 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [req-44355412-e08d-4fb9-b15e-234097e21d14 req-d0143ef7-a925-4f05-ba10-e91e921d699b service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:17.610414 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [req-44355412-e08d-4fb9-b15e-234097e21d14 req-d0143ef7-a925-4f05-ba10-e91e921d699b service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:17.632315 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.compute.server_external_events [req-44355412-e08d-4fb9-b15e-234097e21d14 req-d0143ef7-a925-4f05-ba10-e91e921d699b service nova] Creating event network-vif-deleted:70ed00d8-0269-4fd7-95ad-a77218f83e0d for instance 6644ea64-dd17-4874-b6ed-9a19b951a3a3 on hv-cinder-83699 Jun 07 09:30:17.642770 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [req-44355412-e08d-4fb9-b15e-234097e21d14 req-d0143ef7-a925-4f05-ba10-e91e921d699b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057906 Jun 07 09:30:17.645846 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 183/366] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Jun 7 09:30:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:30:17.767422 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-a7199529-5418-435c-bd02-2fc7e3a89da1 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:30:17.774797 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-a7199529-5418-435c-bd02-2fc7e3a89da1 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4" status: 200 len: 1521 microversion: 2.1 time: 0.187555 Jun 07 09:30:17.775418 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 184/367] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:30:17 2022] GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4 => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:30:18.503147 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-3544d403-3007-4f12-9e4c-c5b049e9c8ac tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:30:18.503851 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-3544d403-3007-4f12-9e4c-c5b049e9c8ac tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] [instance: 6644ea64-dd17-4874-b6ed-9a19b951a3a3] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:30:18.511974 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-3544d403-3007-4f12-9e4c-c5b049e9c8ac tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:18.512675 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-3544d403-3007-4f12-9e4c-c5b049e9c8ac tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:18.513456 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-3544d403-3007-4f12-9e4c-c5b049e9c8ac tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:18.513907 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-3544d403-3007-4f12-9e4c-c5b049e9c8ac tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:18.555694 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-3544d403-3007-4f12-9e4c-c5b049e9c8ac tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:18.556368 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-3544d403-3007-4f12-9e4c-c5b049e9c8ac tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:18.557048 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.objects.instance [None req-3544d403-3007-4f12-9e4c-c5b049e9c8ac tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Lazy-loading 'fault' on Instance uuid 6644ea64-dd17-4874-b6ed-9a19b951a3a3 {{(pid=118740) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 09:30:18.611261 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-3544d403-3007-4f12-9e4c-c5b049e9c8ac tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e44a60fc7244d6d88a20aeac53c3353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44089f44ea384df88ea8e9411dc94476', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:30:18.618852 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-3544d403-3007-4f12-9e4c-c5b049e9c8ac tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] 10.222.0.57 "GET /compute/v2.1/servers/6644ea64-dd17-4874-b6ed-9a19b951a3a3" status: 200 len: 1305 microversion: 2.1 time: 0.120881 Jun 07 09:30:18.619630 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 184/368] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:30:18 2022] GET /compute/v2.1/servers/6644ea64-dd17-4874-b6ed-9a19b951a3a3 => generated 1305 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:30:18.802371 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-b7f90c07-f952-47aa-b445-0c42c6805ec3 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:30:18.802371 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-b7f90c07-f952-47aa-b445-0c42c6805ec3 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:30:18.802371 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b7f90c07-f952-47aa-b445-0c42c6805ec3 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:18.802371 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b7f90c07-f952-47aa-b445-0c42c6805ec3 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:18.803073 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b7f90c07-f952-47aa-b445-0c42c6805ec3 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:18.803073 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b7f90c07-f952-47aa-b445-0c42c6805ec3 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:18.940667 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-b7f90c07-f952-47aa-b445-0c42c6805ec3 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:30:18.949626 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-b7f90c07-f952-47aa-b445-0c42c6805ec3 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4" status: 200 len: 1521 microversion: 2.1 time: 0.162326 Jun 07 09:30:18.950562 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 185/369] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:30:18 2022] GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:30:19.636808 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-f7b14761-fc4e-4980-bf61-3769b077f03c tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:30:19.637429 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-f7b14761-fc4e-4980-bf61-3769b077f03c tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] [instance: 6644ea64-dd17-4874-b6ed-9a19b951a3a3] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:30:19.644418 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-f7b14761-fc4e-4980-bf61-3769b077f03c tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:19.644970 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-f7b14761-fc4e-4980-bf61-3769b077f03c tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:19.645757 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-f7b14761-fc4e-4980-bf61-3769b077f03c tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:19.646194 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-f7b14761-fc4e-4980-bf61-3769b077f03c tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:19.661479 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.wsgi [None req-f7b14761-fc4e-4980-bf61-3769b077f03c tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] HTTP exception thrown: Instance 6644ea64-dd17-4874-b6ed-9a19b951a3a3 could not be found. Jun 07 09:30:19.663111 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-f7b14761-fc4e-4980-bf61-3769b077f03c tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Request method failure captured: Jun 07 09:30:19.663111 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: request: GET /compute/v2.1/servers/6644ea64-dd17-4874-b6ed-9a19b951a3a3 HTTP/1.1 Jun 07 09:30:19.663111 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Accept: application/json Jun 07 09:30:19.663111 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Accept-Encoding: identity Jun 07 09:30:19.663111 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Connection: close Jun 07 09:30:19.663111 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Content-Length: 0 Jun 07 09:30:19.663111 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Content-Type: application/json Jun 07 09:30:19.663111 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Host: 10.222.0.57 Jun 07 09:30:19.663111 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Openstack-System-Scope: None Jun 07 09:30:19.663111 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: User-Agent: python-urllib3/1.26.9 Jun 07 09:30:19.663111 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Auth-Token: gAAAAABinxqQk77DMfmiiBMNgNu8b9aTHgRg6mBuI6A7U8FyX28KrndnNr7Cri6lexJOz9VQaOakXzhuUQvUbDz0_3tMIH-eCiCwjBJepdbrbjpIOY2tXz-iRwt6pmI7I2PjkoLj1zmhi4wwA8i0fL-cpbhIapTDH9qp_yBakWQVOgvhshJKgIw Jun 07 09:30:19.663111 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Domain-Id: None Jun 07 09:30:19.663111 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Domain-Name: None Jun 07 09:30:19.663111 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Identity-Status: Confirmed Jun 07 09:30:19.663111 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Is-Admin-Project: True Jun 07 09:30:19.663111 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Domain-Id: default Jun 07 09:30:19.663111 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Domain-Name: Default Jun 07 09:30:19.663111 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Id: 44089f44ea384df88ea8e9411dc94476 Jun 07 09:30:19.663111 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Name: tempest-VolumesNegativeTest-1815993057 Jun 07 09:30:19.663111 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Role: reader,member Jun 07 09:30:19.663111 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Roles: reader,member Jun 07 09:30:19.664381 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/44089f44ea384df88ea8e9411dc94476"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/44089f44ea384df88ea8e9411dc94476"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_44089f44ea384df88ea8e9411dc94476"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/44089f44ea384df88ea8e9411dc94476"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 07 09:30:19.664381 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Tenant: tempest-VolumesNegativeTest-1815993057 Jun 07 09:30:19.664381 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Tenant-Id: 44089f44ea384df88ea8e9411dc94476 Jun 07 09:30:19.664381 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Tenant-Name: tempest-VolumesNegativeTest-1815993057 Jun 07 09:30:19.664381 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User: tempest-VolumesNegativeTest-1815993057-project Jun 07 09:30:19.664381 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Domain-Id: default Jun 07 09:30:19.664381 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Domain-Name: Default Jun 07 09:30:19.664381 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Id: 7e44a60fc7244d6d88a20aeac53c3353 Jun 07 09:30:19.664381 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Name: tempest-VolumesNegativeTest-1815993057-project Jun 07 09:30:19.664381 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: method: > Jun 07 09:30:19.664381 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: exception: Instance 6644ea64-dd17-4874-b6ed-9a19b951a3a3 could not be found. Jun 07 09:30:19.664381 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: action_args: {'id': '6644ea64-dd17-4874-b6ed-9a19b951a3a3'} Jun 07 09:30:19.665117 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 09:30:19.665117 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:30:19.665117 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 09:30:19.665117 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 09:30:19.665117 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 09:30:19.665117 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 09:30:19.665117 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 09:30:19.665117 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 09:30:19.665117 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 09:30:19.665117 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 09:30:19.665117 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6644ea64-dd17-4874-b6ed-9a19b951a3a3 could not be found. Jun 07 09:30:19.665117 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:30:19.665117 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:30:19.665117 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:30:19.665117 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:30:19.665117 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:30:19.665117 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:30:19.665117 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 09:30:19.665117 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 09:30:19.665117 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 09:30:19.666179 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 09:30:19.666179 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 09:30:19.666179 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 09:30:19.666179 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 09:30:19.666179 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 09:30:19.666179 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 09:30:19.666179 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 09:30:19.666179 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6644ea64-dd17-4874-b6ed-9a19b951a3a3 could not be found. Jun 07 09:30:19.666179 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:30:19.666179 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:30:19.666179 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:30:19.666179 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:30:19.666179 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:30:19.666179 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:30:19.666179 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 09:30:19.666179 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 09:30:19.666179 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6644ea64-dd17-4874-b6ed-9a19b951a3a3 could not be found. Jun 07 09:30:19.666179 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:30:19.667133 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-f7b14761-fc4e-4980-bf61-3769b077f03c tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] Returning 404 to user: Instance 6644ea64-dd17-4874-b6ed-9a19b951a3a3 could not be found. {{(pid=118740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 09:30:19.667133 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-f7b14761-fc4e-4980-bf61-3769b077f03c tempest-VolumesNegativeTest-1815993057 tempest-VolumesNegativeTest-1815993057-project] 10.222.0.57 "GET /compute/v2.1/servers/6644ea64-dd17-4874-b6ed-9a19b951a3a3" status: 404 len: 111 microversion: 2.1 time: 0.032079 Jun 07 09:30:19.667133 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 185/370] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:30:19 2022] GET /compute/v2.1/servers/6644ea64-dd17-4874-b6ed-9a19b951a3a3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 09:30:19.966577 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-006ee0f7-4a5c-433d-ad53-d04f4e07b953 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:30:19.967179 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-006ee0f7-4a5c-433d-ad53-d04f4e07b953 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:30:19.973057 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-006ee0f7-4a5c-433d-ad53-d04f4e07b953 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:19.974358 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-006ee0f7-4a5c-433d-ad53-d04f4e07b953 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:19.975120 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-006ee0f7-4a5c-433d-ad53-d04f4e07b953 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:19.975545 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-006ee0f7-4a5c-433d-ad53-d04f4e07b953 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:20.155927 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-006ee0f7-4a5c-433d-ad53-d04f4e07b953 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:30:20.163664 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-006ee0f7-4a5c-433d-ad53-d04f4e07b953 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4" status: 200 len: 1521 microversion: 2.1 time: 0.200833 Jun 07 09:30:20.164474 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 186/371] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:30:19 2022] GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4 => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:30:21.181631 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-f1e2d0fd-4e92-4e65-af26-9153e1e91725 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:30:21.182873 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-f1e2d0fd-4e92-4e65-af26-9153e1e91725 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:30:21.189887 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-f1e2d0fd-4e92-4e65-af26-9153e1e91725 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:21.190421 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-f1e2d0fd-4e92-4e65-af26-9153e1e91725 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:21.191203 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-f1e2d0fd-4e92-4e65-af26-9153e1e91725 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:21.191675 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-f1e2d0fd-4e92-4e65-af26-9153e1e91725 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:21.476802 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-f1e2d0fd-4e92-4e65-af26-9153e1e91725 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:30:21.492614 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-f1e2d0fd-4e92-4e65-af26-9153e1e91725 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4" status: 200 len: 1521 microversion: 2.1 time: 0.307039 Jun 07 09:30:21.502480 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 186/372] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:30:21 2022] GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4 => generated 1521 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:30:22.509535 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-320ab2d4-758d-4bed-b0fa-a72007b1eb22 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:30:22.510134 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-320ab2d4-758d-4bed-b0fa-a72007b1eb22 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:30:22.516433 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-320ab2d4-758d-4bed-b0fa-a72007b1eb22 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:22.516919 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-320ab2d4-758d-4bed-b0fa-a72007b1eb22 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:22.517670 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-320ab2d4-758d-4bed-b0fa-a72007b1eb22 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:22.518100 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-320ab2d4-758d-4bed-b0fa-a72007b1eb22 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:22.655123 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-320ab2d4-758d-4bed-b0fa-a72007b1eb22 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:30:22.663213 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-320ab2d4-758d-4bed-b0fa-a72007b1eb22 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4" status: 200 len: 1521 microversion: 2.1 time: 0.157507 Jun 07 09:30:22.663779 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 187/373] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:30:22 2022] GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:30:23.680628 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-a52880b6-0d01-4513-9782-60d34643e805 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:30:23.681430 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-a52880b6-0d01-4513-9782-60d34643e805 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:30:23.688234 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-a52880b6-0d01-4513-9782-60d34643e805 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:23.688712 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-a52880b6-0d01-4513-9782-60d34643e805 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:23.689519 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-a52880b6-0d01-4513-9782-60d34643e805 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:23.689958 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-a52880b6-0d01-4513-9782-60d34643e805 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:23.906782 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-a52880b6-0d01-4513-9782-60d34643e805 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:30:23.906782 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-a52880b6-0d01-4513-9782-60d34643e805 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4" status: 200 len: 1521 microversion: 2.1 time: 0.156817 Jun 07 09:30:23.906782 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 187/374] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:30:23 2022] GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:30:24.930468 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-e3af630c-fbce-47e2-8b7e-2a99b567e1e0 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:30:24.931204 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-e3af630c-fbce-47e2-8b7e-2a99b567e1e0 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:30:24.940925 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-e3af630c-fbce-47e2-8b7e-2a99b567e1e0 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:24.941612 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-e3af630c-fbce-47e2-8b7e-2a99b567e1e0 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:24.943301 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-e3af630c-fbce-47e2-8b7e-2a99b567e1e0 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:24.944861 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-e3af630c-fbce-47e2-8b7e-2a99b567e1e0 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:25.144408 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-e3af630c-fbce-47e2-8b7e-2a99b567e1e0 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:30:25.155648 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-e3af630c-fbce-47e2-8b7e-2a99b567e1e0 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4" status: 200 len: 1521 microversion: 2.1 time: 0.230111 Jun 07 09:30:25.156343 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 188/375] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:30:24 2022] GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4 => generated 1521 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:30:26.172970 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-bf27383e-e683-4878-9b92-0c3656681913 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:30:26.173582 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-bf27383e-e683-4878-9b92-0c3656681913 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:30:26.181801 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-bf27383e-e683-4878-9b92-0c3656681913 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:26.182510 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-bf27383e-e683-4878-9b92-0c3656681913 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:26.184236 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-bf27383e-e683-4878-9b92-0c3656681913 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:26.184716 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-bf27383e-e683-4878-9b92-0c3656681913 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:26.336205 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-bf27383e-e683-4878-9b92-0c3656681913 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:30:26.344763 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-bf27383e-e683-4878-9b92-0c3656681913 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4" status: 200 len: 1521 microversion: 2.1 time: 0.174881 Jun 07 09:30:26.344763 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 188/376] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:30:26 2022] GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:30:27.361095 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-a16b713a-f36f-477e-97be-ef715d64e229 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:30:27.361742 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-a16b713a-f36f-477e-97be-ef715d64e229 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:30:27.367818 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-a16b713a-f36f-477e-97be-ef715d64e229 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:27.368567 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-a16b713a-f36f-477e-97be-ef715d64e229 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:27.369384 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-a16b713a-f36f-477e-97be-ef715d64e229 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:27.369886 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-a16b713a-f36f-477e-97be-ef715d64e229 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:27.508344 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-a16b713a-f36f-477e-97be-ef715d64e229 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:30:27.517885 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-a16b713a-f36f-477e-97be-ef715d64e229 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4" status: 200 len: 1521 microversion: 2.1 time: 0.159898 Jun 07 09:30:27.517885 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 189/377] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:30:27 2022] GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:30:28.534971 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-1e5635cc-f4ac-4de3-9edd-bf599f931338 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:30:28.535591 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-1e5635cc-f4ac-4de3-9edd-bf599f931338 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:30:28.542212 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-1e5635cc-f4ac-4de3-9edd-bf599f931338 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:28.542664 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-1e5635cc-f4ac-4de3-9edd-bf599f931338 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:28.549680 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-1e5635cc-f4ac-4de3-9edd-bf599f931338 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:28.549680 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-1e5635cc-f4ac-4de3-9edd-bf599f931338 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:28.675721 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-1e5635cc-f4ac-4de3-9edd-bf599f931338 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:30:28.683887 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-1e5635cc-f4ac-4de3-9edd-bf599f931338 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4" status: 200 len: 1521 microversion: 2.1 time: 0.154230 Jun 07 09:30:28.684448 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 189/378] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:30:28 2022] GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:30:29.700673 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-8847a58b-ae18-4ed4-ab0e-27c3195a64e6 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:30:29.701398 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-8847a58b-ae18-4ed4-ab0e-27c3195a64e6 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:30:29.709718 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-8847a58b-ae18-4ed4-ab0e-27c3195a64e6 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:29.710170 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-8847a58b-ae18-4ed4-ab0e-27c3195a64e6 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:29.710953 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-8847a58b-ae18-4ed4-ab0e-27c3195a64e6 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:29.711390 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-8847a58b-ae18-4ed4-ab0e-27c3195a64e6 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:29.851632 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-8847a58b-ae18-4ed4-ab0e-27c3195a64e6 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:30:29.863886 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-8847a58b-ae18-4ed4-ab0e-27c3195a64e6 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4" status: 200 len: 1521 microversion: 2.1 time: 0.163764 Jun 07 09:30:29.863886 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 190/379] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:30:29 2022] GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:30:30.876893 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-e7ca5f79-849b-4f90-adf3-fd1b9265d7c1 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:30:30.877496 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-e7ca5f79-849b-4f90-adf3-fd1b9265d7c1 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:30:30.902363 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-e7ca5f79-849b-4f90-adf3-fd1b9265d7c1 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:30.902363 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-e7ca5f79-849b-4f90-adf3-fd1b9265d7c1 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:30.902363 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-e7ca5f79-849b-4f90-adf3-fd1b9265d7c1 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:30.902363 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-e7ca5f79-849b-4f90-adf3-fd1b9265d7c1 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:31.021372 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-e7ca5f79-849b-4f90-adf3-fd1b9265d7c1 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:30:31.029069 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-e7ca5f79-849b-4f90-adf3-fd1b9265d7c1 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4" status: 200 len: 1521 microversion: 2.1 time: 0.155874 Jun 07 09:30:31.029552 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 190/380] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:30:30 2022] GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:30:32.045929 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-cf7d1de5-eb38-47b1-8f04-55e44ac98b9f tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:30:32.046450 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-cf7d1de5-eb38-47b1-8f04-55e44ac98b9f tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:30:32.052827 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-cf7d1de5-eb38-47b1-8f04-55e44ac98b9f tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:32.053274 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-cf7d1de5-eb38-47b1-8f04-55e44ac98b9f tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:32.054032 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-cf7d1de5-eb38-47b1-8f04-55e44ac98b9f tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:32.054467 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-cf7d1de5-eb38-47b1-8f04-55e44ac98b9f tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:32.186706 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-cf7d1de5-eb38-47b1-8f04-55e44ac98b9f tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:30:32.194409 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-cf7d1de5-eb38-47b1-8f04-55e44ac98b9f tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4" status: 200 len: 1501 microversion: 2.1 time: 0.152453 Jun 07 09:30:32.194971 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 191/381] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:30:32 2022] GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4 => generated 1501 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:30:32.211072 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-7ce65306-f7a8-419a-822a-1e261da19c3f tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:30:32.212950 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-7ce65306-f7a8-419a-822a-1e261da19c3f tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: 77d18a34-ad63-453f-9b17-517bd85a6f42] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:30:32.218276 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-7ce65306-f7a8-419a-822a-1e261da19c3f tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:32.218735 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-7ce65306-f7a8-419a-822a-1e261da19c3f tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:32.219498 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-7ce65306-f7a8-419a-822a-1e261da19c3f tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:32.219974 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-7ce65306-f7a8-419a-822a-1e261da19c3f tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:32.351109 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-7ce65306-f7a8-419a-822a-1e261da19c3f tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:30:32.359184 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-7ce65306-f7a8-419a-822a-1e261da19c3f tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/77d18a34-ad63-453f-9b17-517bd85a6f42" status: 200 len: 1515 microversion: 2.1 time: 0.151984 Jun 07 09:30:32.359771 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 191/382] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:30:32 2022] GET /compute/v2.1/servers/77d18a34-ad63-453f-9b17-517bd85a6f42 => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:30:35.273672 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-127bc882-cb6d-4810-805e-bca61035e2df tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:30:35.274915 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-127bc882-cb6d-4810-805e-bca61035e2df tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: 77d18a34-ad63-453f-9b17-517bd85a6f42] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:30:35.277063 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writing DB stats nova_api:SELECT=58 {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:30:35.281788 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-127bc882-cb6d-4810-805e-bca61035e2df tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:35.282303 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-127bc882-cb6d-4810-805e-bca61035e2df tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:35.283060 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-127bc882-cb6d-4810-805e-bca61035e2df tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:35.283485 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-127bc882-cb6d-4810-805e-bca61035e2df tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:35.297533 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writing DB stats nova_cell1:SELECT=100 {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:30:35.306514 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.objects.instance [None req-127bc882-cb6d-4810-805e-bca61035e2df tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lazy-loading 'flavor' on Instance uuid 77d18a34-ad63-453f-9b17-517bd85a6f42 {{(pid=118741) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 09:30:35.658384 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-127bc882-cb6d-4810-805e-bca61035e2df tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "POST /compute/v2.1/servers/77d18a34-ad63-453f-9b17-517bd85a6f42/action" status: 200 len: 32 microversion: 2.1 time: 0.390227 Jun 07 09:30:35.659033 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 192/383] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Jun 7 09:30:35 2022] POST /compute/v2.1/servers/77d18a34-ad63-453f-9b17-517bd85a6f42/action => generated 32 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 07 09:30:35.668607 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-2f379a7c-b6e2-4a63-8563-b04517b81aae tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:30:35.669254 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-2f379a7c-b6e2-4a63-8563-b04517b81aae tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: 77d18a34-ad63-453f-9b17-517bd85a6f42] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:30:35.675686 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-2f379a7c-b6e2-4a63-8563-b04517b81aae tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:35.676127 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-2f379a7c-b6e2-4a63-8563-b04517b81aae tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:35.676917 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-2f379a7c-b6e2-4a63-8563-b04517b81aae tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:35.677349 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-2f379a7c-b6e2-4a63-8563-b04517b81aae tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:35.821028 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-2f379a7c-b6e2-4a63-8563-b04517b81aae tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:30:35.828861 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-2f379a7c-b6e2-4a63-8563-b04517b81aae tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/77d18a34-ad63-453f-9b17-517bd85a6f42" status: 200 len: 1521 microversion: 2.1 time: 0.164529 Jun 07 09:30:35.829433 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 192/384] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:30:35 2022] GET /compute/v2.1/servers/77d18a34-ad63-453f-9b17-517bd85a6f42 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:30:36.847387 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-095441ba-c8aa-42a7-94e7-40e636993cb7 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:30:36.848112 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-095441ba-c8aa-42a7-94e7-40e636993cb7 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: 77d18a34-ad63-453f-9b17-517bd85a6f42] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:30:36.855218 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-095441ba-c8aa-42a7-94e7-40e636993cb7 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:36.865616 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-095441ba-c8aa-42a7-94e7-40e636993cb7 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:36.865616 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-095441ba-c8aa-42a7-94e7-40e636993cb7 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:36.865616 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-095441ba-c8aa-42a7-94e7-40e636993cb7 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:36.999265 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-095441ba-c8aa-42a7-94e7-40e636993cb7 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:30:37.008249 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-095441ba-c8aa-42a7-94e7-40e636993cb7 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/77d18a34-ad63-453f-9b17-517bd85a6f42" status: 200 len: 1521 microversion: 2.1 time: 0.165294 Jun 07 09:30:37.009052 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 193/385] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:30:36 2022] GET /compute/v2.1/servers/77d18a34-ad63-453f-9b17-517bd85a6f42 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:30:38.025764 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-fa66c3b1-2a10-4fb0-bdc3-59adba06bfc5 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:30:38.026946 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-fa66c3b1-2a10-4fb0-bdc3-59adba06bfc5 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: 77d18a34-ad63-453f-9b17-517bd85a6f42] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:30:38.033857 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-fa66c3b1-2a10-4fb0-bdc3-59adba06bfc5 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:38.034308 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-fa66c3b1-2a10-4fb0-bdc3-59adba06bfc5 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:38.036325 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-fa66c3b1-2a10-4fb0-bdc3-59adba06bfc5 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:38.036325 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-fa66c3b1-2a10-4fb0-bdc3-59adba06bfc5 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:38.171314 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-fa66c3b1-2a10-4fb0-bdc3-59adba06bfc5 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:30:38.179263 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-fa66c3b1-2a10-4fb0-bdc3-59adba06bfc5 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/77d18a34-ad63-453f-9b17-517bd85a6f42" status: 200 len: 1521 microversion: 2.1 time: 0.157443 Jun 07 09:30:38.179772 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 193/386] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:30:38 2022] GET /compute/v2.1/servers/77d18a34-ad63-453f-9b17-517bd85a6f42 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:30:39.197527 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-1c217071-fbba-4246-baf1-ad20db79fb04 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:30:39.198224 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-1c217071-fbba-4246-baf1-ad20db79fb04 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: 77d18a34-ad63-453f-9b17-517bd85a6f42] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:30:39.204761 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-1c217071-fbba-4246-baf1-ad20db79fb04 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:39.205445 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-1c217071-fbba-4246-baf1-ad20db79fb04 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:39.206238 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-1c217071-fbba-4246-baf1-ad20db79fb04 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:39.206834 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-1c217071-fbba-4246-baf1-ad20db79fb04 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:39.336923 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-1c217071-fbba-4246-baf1-ad20db79fb04 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:30:39.345117 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-1c217071-fbba-4246-baf1-ad20db79fb04 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/77d18a34-ad63-453f-9b17-517bd85a6f42" status: 200 len: 1521 microversion: 2.1 time: 0.151838 Jun 07 09:30:39.345676 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 194/387] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:30:39 2022] GET /compute/v2.1/servers/77d18a34-ad63-453f-9b17-517bd85a6f42 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:30:40.362452 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-0786d70a-c040-49c0-9f82-8b312fe7069d tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:30:40.363079 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-0786d70a-c040-49c0-9f82-8b312fe7069d tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: 77d18a34-ad63-453f-9b17-517bd85a6f42] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:30:40.370678 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-0786d70a-c040-49c0-9f82-8b312fe7069d tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:40.371118 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-0786d70a-c040-49c0-9f82-8b312fe7069d tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:40.371877 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-0786d70a-c040-49c0-9f82-8b312fe7069d tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:40.372304 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-0786d70a-c040-49c0-9f82-8b312fe7069d tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:40.508343 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-0786d70a-c040-49c0-9f82-8b312fe7069d tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:30:40.517151 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-0786d70a-c040-49c0-9f82-8b312fe7069d tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/77d18a34-ad63-453f-9b17-517bd85a6f42" status: 200 len: 1521 microversion: 2.1 time: 0.158608 Jun 07 09:30:40.517725 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 194/388] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:30:40 2022] GET /compute/v2.1/servers/77d18a34-ad63-453f-9b17-517bd85a6f42 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:30:41.534447 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-780e4f74-17dc-4131-9dc3-3c4041bc8553 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:30:41.535066 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-780e4f74-17dc-4131-9dc3-3c4041bc8553 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: 77d18a34-ad63-453f-9b17-517bd85a6f42] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:30:41.541233 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-780e4f74-17dc-4131-9dc3-3c4041bc8553 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:41.541686 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-780e4f74-17dc-4131-9dc3-3c4041bc8553 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:41.542445 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-780e4f74-17dc-4131-9dc3-3c4041bc8553 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:41.542881 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-780e4f74-17dc-4131-9dc3-3c4041bc8553 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:41.683075 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-780e4f74-17dc-4131-9dc3-3c4041bc8553 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:30:41.692036 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-780e4f74-17dc-4131-9dc3-3c4041bc8553 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/77d18a34-ad63-453f-9b17-517bd85a6f42" status: 200 len: 1521 microversion: 2.1 time: 0.161687 Jun 07 09:30:41.693812 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 195/389] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:30:41 2022] GET /compute/v2.1/servers/77d18a34-ad63-453f-9b17-517bd85a6f42 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:30:42.714420 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-29489f7a-e31b-4cc0-aac2-62372a4090d1 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:30:42.720869 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-29489f7a-e31b-4cc0-aac2-62372a4090d1 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: 77d18a34-ad63-453f-9b17-517bd85a6f42] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:30:42.721065 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:30:42.726366 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-29489f7a-e31b-4cc0-aac2-62372a4090d1 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:42.730481 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-29489f7a-e31b-4cc0-aac2-62372a4090d1 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:42.730481 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-29489f7a-e31b-4cc0-aac2-62372a4090d1 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:42.730481 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-29489f7a-e31b-4cc0-aac2-62372a4090d1 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:42.877304 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-29489f7a-e31b-4cc0-aac2-62372a4090d1 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:30:42.886807 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-29489f7a-e31b-4cc0-aac2-62372a4090d1 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/77d18a34-ad63-453f-9b17-517bd85a6f42" status: 200 len: 1521 microversion: 2.1 time: 0.180888 Jun 07 09:30:42.887381 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 195/390] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:30:42 2022] GET /compute/v2.1/servers/77d18a34-ad63-453f-9b17-517bd85a6f42 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:30:43.904170 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-7ab0898e-f0a4-4bf8-b565-f3085cd7b0ce tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:30:43.905054 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-7ab0898e-f0a4-4bf8-b565-f3085cd7b0ce tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: 77d18a34-ad63-453f-9b17-517bd85a6f42] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:30:43.911244 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-7ab0898e-f0a4-4bf8-b565-f3085cd7b0ce tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:43.911687 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-7ab0898e-f0a4-4bf8-b565-f3085cd7b0ce tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:43.912430 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-7ab0898e-f0a4-4bf8-b565-f3085cd7b0ce tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:43.912882 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-7ab0898e-f0a4-4bf8-b565-f3085cd7b0ce tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:44.069665 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-7ab0898e-f0a4-4bf8-b565-f3085cd7b0ce tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:30:44.078788 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-7ab0898e-f0a4-4bf8-b565-f3085cd7b0ce tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/77d18a34-ad63-453f-9b17-517bd85a6f42" status: 200 len: 1521 microversion: 2.1 time: 0.179365 Jun 07 09:30:44.079476 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 196/391] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:30:43 2022] GET /compute/v2.1/servers/77d18a34-ad63-453f-9b17-517bd85a6f42 => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:30:45.095592 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-47133b2c-12f5-4b5e-88e6-3d092860ccb6 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:30:45.096198 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-47133b2c-12f5-4b5e-88e6-3d092860ccb6 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: 77d18a34-ad63-453f-9b17-517bd85a6f42] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:30:45.102627 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-47133b2c-12f5-4b5e-88e6-3d092860ccb6 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:45.103073 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-47133b2c-12f5-4b5e-88e6-3d092860ccb6 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:45.103827 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-47133b2c-12f5-4b5e-88e6-3d092860ccb6 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:45.104264 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-47133b2c-12f5-4b5e-88e6-3d092860ccb6 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:45.234084 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-47133b2c-12f5-4b5e-88e6-3d092860ccb6 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:30:45.241708 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-47133b2c-12f5-4b5e-88e6-3d092860ccb6 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/77d18a34-ad63-453f-9b17-517bd85a6f42" status: 200 len: 1521 microversion: 2.1 time: 0.150600 Jun 07 09:30:45.242268 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 196/392] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:30:45 2022] GET /compute/v2.1/servers/77d18a34-ad63-453f-9b17-517bd85a6f42 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:30:46.258421 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-ea5fe50f-e5af-4712-91cb-71a67ad11754 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:30:46.259056 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-ea5fe50f-e5af-4712-91cb-71a67ad11754 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: 77d18a34-ad63-453f-9b17-517bd85a6f42] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:30:46.265033 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-ea5fe50f-e5af-4712-91cb-71a67ad11754 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:46.266998 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-ea5fe50f-e5af-4712-91cb-71a67ad11754 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:46.266998 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-ea5fe50f-e5af-4712-91cb-71a67ad11754 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:46.266998 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-ea5fe50f-e5af-4712-91cb-71a67ad11754 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:46.401246 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-ea5fe50f-e5af-4712-91cb-71a67ad11754 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:30:46.409082 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-ea5fe50f-e5af-4712-91cb-71a67ad11754 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/77d18a34-ad63-453f-9b17-517bd85a6f42" status: 200 len: 1521 microversion: 2.1 time: 0.154490 Jun 07 09:30:46.409642 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 197/393] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:30:46 2022] GET /compute/v2.1/servers/77d18a34-ad63-453f-9b17-517bd85a6f42 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:30:47.425985 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-146b80be-c530-472a-a0dd-eb575d19997e tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:30:47.426612 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-146b80be-c530-472a-a0dd-eb575d19997e tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: 77d18a34-ad63-453f-9b17-517bd85a6f42] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:30:47.433168 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-146b80be-c530-472a-a0dd-eb575d19997e tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:47.433618 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-146b80be-c530-472a-a0dd-eb575d19997e tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:47.434381 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-146b80be-c530-472a-a0dd-eb575d19997e tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:47.434820 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-146b80be-c530-472a-a0dd-eb575d19997e tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:47.562375 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-146b80be-c530-472a-a0dd-eb575d19997e tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:30:47.570198 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-146b80be-c530-472a-a0dd-eb575d19997e tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/77d18a34-ad63-453f-9b17-517bd85a6f42" status: 200 len: 1521 microversion: 2.1 time: 0.148036 Jun 07 09:30:47.570987 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 197/394] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:30:47 2022] GET /compute/v2.1/servers/77d18a34-ad63-453f-9b17-517bd85a6f42 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:30:48.587464 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-bca98555-964b-4a7b-8b29-7a9b77784d20 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:30:48.588251 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-bca98555-964b-4a7b-8b29-7a9b77784d20 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: 77d18a34-ad63-453f-9b17-517bd85a6f42] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:30:48.596249 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-bca98555-964b-4a7b-8b29-7a9b77784d20 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:48.596969 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-bca98555-964b-4a7b-8b29-7a9b77784d20 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:48.597745 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-bca98555-964b-4a7b-8b29-7a9b77784d20 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:48.598180 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-bca98555-964b-4a7b-8b29-7a9b77784d20 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:48.790559 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-bca98555-964b-4a7b-8b29-7a9b77784d20 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:30:48.798700 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-bca98555-964b-4a7b-8b29-7a9b77784d20 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/77d18a34-ad63-453f-9b17-517bd85a6f42" status: 200 len: 1521 microversion: 2.1 time: 0.215304 Jun 07 09:30:48.799196 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 198/395] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:30:48 2022] GET /compute/v2.1/servers/77d18a34-ad63-453f-9b17-517bd85a6f42 => generated 1521 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:30:49.815795 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-cac34efa-9fc9-42fa-bc9f-7cce559d2cc1 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:30:49.816497 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-cac34efa-9fc9-42fa-bc9f-7cce559d2cc1 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: 77d18a34-ad63-453f-9b17-517bd85a6f42] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:30:49.823264 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-cac34efa-9fc9-42fa-bc9f-7cce559d2cc1 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:49.823709 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-cac34efa-9fc9-42fa-bc9f-7cce559d2cc1 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:49.824473 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-cac34efa-9fc9-42fa-bc9f-7cce559d2cc1 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:49.824926 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-cac34efa-9fc9-42fa-bc9f-7cce559d2cc1 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:49.827482 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writing DB stats nova_cell1:SELECT=92 {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:30:49.954498 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-cac34efa-9fc9-42fa-bc9f-7cce559d2cc1 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:30:49.962236 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-cac34efa-9fc9-42fa-bc9f-7cce559d2cc1 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/77d18a34-ad63-453f-9b17-517bd85a6f42" status: 200 len: 1521 microversion: 2.1 time: 0.150291 Jun 07 09:30:49.962836 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 198/396] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:30:49 2022] GET /compute/v2.1/servers/77d18a34-ad63-453f-9b17-517bd85a6f42 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:30:50.985181 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-1dcc2e84-472a-418c-b01d-0455c9d9cf24 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:30:50.985792 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-1dcc2e84-472a-418c-b01d-0455c9d9cf24 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: 77d18a34-ad63-453f-9b17-517bd85a6f42] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:30:50.992448 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-1dcc2e84-472a-418c-b01d-0455c9d9cf24 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:50.992972 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-1dcc2e84-472a-418c-b01d-0455c9d9cf24 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:50.993749 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-1dcc2e84-472a-418c-b01d-0455c9d9cf24 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:50.994170 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-1dcc2e84-472a-418c-b01d-0455c9d9cf24 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:51.125486 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-1dcc2e84-472a-418c-b01d-0455c9d9cf24 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:30:51.132919 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-1dcc2e84-472a-418c-b01d-0455c9d9cf24 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/77d18a34-ad63-453f-9b17-517bd85a6f42" status: 200 len: 1501 microversion: 2.1 time: 0.152602 Jun 07 09:30:51.133570 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 199/397] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:30:50 2022] GET /compute/v2.1/servers/77d18a34-ad63-453f-9b17-517bd85a6f42 => generated 1501 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:30:51.150286 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-68a46c3c-992b-4797-a12a-3e97ee7b740f tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "efb8aaa3-471a-4160-aaed-3e2b60fe2b8f"}} {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:30:51.151410 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-68a46c3c-992b-4797-a12a-3e97ee7b740f tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: 77d18a34-ad63-453f-9b17-517bd85a6f42] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:30:51.159062 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-68a46c3c-992b-4797-a12a-3e97ee7b740f tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:51.159528 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-68a46c3c-992b-4797-a12a-3e97ee7b740f tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:51.160339 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-68a46c3c-992b-4797-a12a-3e97ee7b740f tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:51.160845 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-68a46c3c-992b-4797-a12a-3e97ee7b740f tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:51.183061 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.wsgi [None req-68a46c3c-992b-4797-a12a-3e97ee7b740f tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] HTTP exception thrown: Cannot 'attach_volume' instance 77d18a34-ad63-453f-9b17-517bd85a6f42 while it is in vm_state rescued Jun 07 09:30:51.184882 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-68a46c3c-992b-4797-a12a-3e97ee7b740f tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Request method failure captured: Jun 07 09:30:51.184882 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: request: POST /compute/v2.1/servers/77d18a34-ad63-453f-9b17-517bd85a6f42/os-volume_attachments HTTP/1.1 Jun 07 09:30:51.184882 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Accept: application/json Jun 07 09:30:51.184882 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Accept-Encoding: identity Jun 07 09:30:51.184882 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Connection: close Jun 07 09:30:51.184882 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Content-Length: 74 Jun 07 09:30:51.184882 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Content-Type: application/json Jun 07 09:30:51.184882 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Host: 10.222.0.57 Jun 07 09:30:51.184882 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Openstack-System-Scope: None Jun 07 09:30:51.184882 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: User-Agent: python-urllib3/1.26.9 Jun 07 09:30:51.184882 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Auth-Token: gAAAAABinxpHQcjMxh2xTkwKSnc212e9lNltr7CXcs8JAM1TEzohifaHGcSWxwjvcbeQvYXzSUgF9FkXSPBP6LjNAbHU5v1fOXfceR_05Bkuv9pRKNML1vL97YHi3ESy-ou5_XJHettmMtf-Zn05sP8wThXG84KcMgam3l7SF6MkmFpBWtrcAjc Jun 07 09:30:51.184882 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Domain-Id: None Jun 07 09:30:51.184882 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Domain-Name: None Jun 07 09:30:51.184882 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Identity-Status: Confirmed Jun 07 09:30:51.184882 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Is-Admin-Project: True Jun 07 09:30:51.184882 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Domain-Id: default Jun 07 09:30:51.184882 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Domain-Name: Default Jun 07 09:30:51.184882 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Id: 856d592872fa47a2b628f1c3e482b2fd Jun 07 09:30:51.184882 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-738162784 Jun 07 09:30:51.184882 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Role: reader,member Jun 07 09:30:51.184882 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Roles: reader,member Jun 07 09:30:51.186507 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/856d592872fa47a2b628f1c3e482b2fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/856d592872fa47a2b628f1c3e482b2fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_856d592872fa47a2b628f1c3e482b2fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/856d592872fa47a2b628f1c3e482b2fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 07 09:30:51.186507 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Tenant: tempest-ServerRescueNegativeTestJSON-738162784 Jun 07 09:30:51.186507 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Tenant-Id: 856d592872fa47a2b628f1c3e482b2fd Jun 07 09:30:51.186507 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-738162784 Jun 07 09:30:51.186507 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User: tempest-ServerRescueNegativeTestJSON-738162784-project Jun 07 09:30:51.186507 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Domain-Id: default Jun 07 09:30:51.186507 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Domain-Name: Default Jun 07 09:30:51.186507 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Id: 75f6d2e28f024875bda0b20f751bdf0d Jun 07 09:30:51.186507 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Name: tempest-ServerRescueNegativeTestJSON-738162784-project Jun 07 09:30:51.186507 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Jun 07 09:30:51.186507 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: {"volumeAttachment": {"volumeId": "efb8aaa3-471a-4160-aaed-3e2b60fe2b8f"}} Jun 07 09:30:51.186507 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: method: > Jun 07 09:30:51.187275 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: exception: Cannot 'attach_volume' instance 77d18a34-ad63-453f-9b17-517bd85a6f42 while it is in vm_state rescued Jun 07 09:30:51.187275 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: action_args: {'server_id': '77d18a34-ad63-453f-9b17-517bd85a6f42', 'body': {'volumeAttachment': {'volumeId': 'efb8aaa3-471a-4160-aaed-3e2b60fe2b8f'}}} Jun 07 09:30:51.187275 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 09:30:51.187275 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:30:51.187275 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 07 09:30:51.187275 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 07 09:30:51.187275 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 07 09:30:51.187275 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 07 09:30:51.187275 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 07 09:30:51.187275 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 07 09:30:51.187275 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 77d18a34-ad63-453f-9b17-517bd85a6f42 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 07 09:30:51.187275 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:30:51.187275 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:30:51.187275 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:30:51.187275 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:30:51.187275 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:30:51.187275 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:30:51.187275 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 09:30:51.187275 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 09:30:51.188496 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 09:30:51.188496 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 09:30:51.188496 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 07 09:30:51.188496 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 09:30:51.188496 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 07 09:30:51.188496 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 09:30:51.188496 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 07 09:30:51.188496 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 09:30:51.188496 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 07 09:30:51.188496 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 07 09:30:51.188496 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 07 09:30:51.188496 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 07 09:30:51.188496 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 77d18a34-ad63-453f-9b17-517bd85a6f42 while it is in vm_state rescued Jun 07 09:30:51.188496 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:30:51.188496 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:30:51.188496 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:30:51.188496 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:30:51.188496 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:30:51.188496 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:30:51.189664 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 09:30:51.189664 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 09:30:51.189664 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 77d18a34-ad63-453f-9b17-517bd85a6f42 while it is in vm_state rescued Jun 07 09:30:51.189664 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:30:51.189664 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-68a46c3c-992b-4797-a12a-3e97ee7b740f tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Returning 409 to user: Cannot 'attach_volume' instance 77d18a34-ad63-453f-9b17-517bd85a6f42 while it is in vm_state rescued {{(pid=118740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 09:30:51.189664 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-68a46c3c-992b-4797-a12a-3e97ee7b740f tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "POST /compute/v2.1/servers/77d18a34-ad63-453f-9b17-517bd85a6f42/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.040552 Jun 07 09:30:51.189664 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 199/398] 10.222.0.57 () {60 vars in 1322 bytes} [Tue Jun 7 09:30:51 2022] POST /compute/v2.1/servers/77d18a34-ad63-453f-9b17-517bd85a6f42/os-volume_attachments => generated 152 bytes in 42 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 07 09:30:51.195451 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-5a932e44-f178-4516-a30a-df801951d852 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:30:51.195986 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-5a932e44-f178-4516-a30a-df801951d852 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: 77d18a34-ad63-453f-9b17-517bd85a6f42] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:30:51.202464 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-5a932e44-f178-4516-a30a-df801951d852 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:51.202936 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-5a932e44-f178-4516-a30a-df801951d852 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:51.203694 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-5a932e44-f178-4516-a30a-df801951d852 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:51.204133 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-5a932e44-f178-4516-a30a-df801951d852 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:51.469275 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-5a932e44-f178-4516-a30a-df801951d852 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "POST /compute/v2.1/servers/77d18a34-ad63-453f-9b17-517bd85a6f42/action" status: 202 len: 0 microversion: 2.1 time: 0.277102 Jun 07 09:30:51.469902 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 200/399] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Jun 7 09:30:51 2022] POST /compute/v2.1/servers/77d18a34-ad63-453f-9b17-517bd85a6f42/action => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 09:30:51.478366 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-5369f41f-e2d7-4ea7-8a5a-1ac0a75361f3 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:30:51.479047 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-5369f41f-e2d7-4ea7-8a5a-1ac0a75361f3 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: 77d18a34-ad63-453f-9b17-517bd85a6f42] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:30:51.486573 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-5369f41f-e2d7-4ea7-8a5a-1ac0a75361f3 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:51.487251 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-5369f41f-e2d7-4ea7-8a5a-1ac0a75361f3 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:51.488064 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-5369f41f-e2d7-4ea7-8a5a-1ac0a75361f3 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:51.488504 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-5369f41f-e2d7-4ea7-8a5a-1ac0a75361f3 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:51.632120 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-5369f41f-e2d7-4ea7-8a5a-1ac0a75361f3 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:30:51.639952 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-5369f41f-e2d7-4ea7-8a5a-1ac0a75361f3 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/77d18a34-ad63-453f-9b17-517bd85a6f42" status: 200 len: 1509 microversion: 2.1 time: 0.165655 Jun 07 09:30:51.640515 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 200/400] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:30:51 2022] GET /compute/v2.1/servers/77d18a34-ad63-453f-9b17-517bd85a6f42 => generated 1509 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:30:52.657839 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-2660e3a0-fadb-4f46-9c27-17e907373635 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:30:52.658690 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-2660e3a0-fadb-4f46-9c27-17e907373635 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: 77d18a34-ad63-453f-9b17-517bd85a6f42] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:30:52.665206 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-2660e3a0-fadb-4f46-9c27-17e907373635 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:52.665720 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-2660e3a0-fadb-4f46-9c27-17e907373635 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:52.666477 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-2660e3a0-fadb-4f46-9c27-17e907373635 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:52.666904 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-2660e3a0-fadb-4f46-9c27-17e907373635 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:52.913483 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-2660e3a0-fadb-4f46-9c27-17e907373635 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:30:52.921455 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-2660e3a0-fadb-4f46-9c27-17e907373635 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/77d18a34-ad63-453f-9b17-517bd85a6f42" status: 200 len: 1509 microversion: 2.1 time: 0.267870 Jun 07 09:30:52.922099 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 201/401] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:30:52 2022] GET /compute/v2.1/servers/77d18a34-ad63-453f-9b17-517bd85a6f42 => generated 1509 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:30:53.939058 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-b1639f17-6c89-446a-823d-25a5003de304 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:30:53.939779 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-b1639f17-6c89-446a-823d-25a5003de304 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: 77d18a34-ad63-453f-9b17-517bd85a6f42] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:30:53.945988 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b1639f17-6c89-446a-823d-25a5003de304 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:53.946470 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b1639f17-6c89-446a-823d-25a5003de304 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:53.949638 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b1639f17-6c89-446a-823d-25a5003de304 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:53.949638 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b1639f17-6c89-446a-823d-25a5003de304 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:54.079953 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-b1639f17-6c89-446a-823d-25a5003de304 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:30:54.088194 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-b1639f17-6c89-446a-823d-25a5003de304 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/77d18a34-ad63-453f-9b17-517bd85a6f42" status: 200 len: 1509 microversion: 2.1 time: 0.153403 Jun 07 09:30:54.088799 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 201/402] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:30:53 2022] GET /compute/v2.1/servers/77d18a34-ad63-453f-9b17-517bd85a6f42 => generated 1509 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:30:55.106807 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-82eda9ab-52c5-4455-b7e5-9319705d658d tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:30:55.107829 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-82eda9ab-52c5-4455-b7e5-9319705d658d tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: 77d18a34-ad63-453f-9b17-517bd85a6f42] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:30:55.117670 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-82eda9ab-52c5-4455-b7e5-9319705d658d tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:55.122036 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-82eda9ab-52c5-4455-b7e5-9319705d658d tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:55.122036 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-82eda9ab-52c5-4455-b7e5-9319705d658d tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:55.122036 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-82eda9ab-52c5-4455-b7e5-9319705d658d tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:55.308545 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-82eda9ab-52c5-4455-b7e5-9319705d658d tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:30:55.315947 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-82eda9ab-52c5-4455-b7e5-9319705d658d tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/77d18a34-ad63-453f-9b17-517bd85a6f42" status: 200 len: 1509 microversion: 2.1 time: 0.214567 Jun 07 09:30:55.316502 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 202/403] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:30:55 2022] GET /compute/v2.1/servers/77d18a34-ad63-453f-9b17-517bd85a6f42 => generated 1509 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:30:56.337501 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-01b56af5-9ac1-46df-ae22-96d66680d8f3 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:30:56.338117 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-01b56af5-9ac1-46df-ae22-96d66680d8f3 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: 77d18a34-ad63-453f-9b17-517bd85a6f42] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:30:56.344758 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-01b56af5-9ac1-46df-ae22-96d66680d8f3 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:56.346266 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-01b56af5-9ac1-46df-ae22-96d66680d8f3 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:56.346266 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-01b56af5-9ac1-46df-ae22-96d66680d8f3 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:30:56.346673 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-01b56af5-9ac1-46df-ae22-96d66680d8f3 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:30:56.488385 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-01b56af5-9ac1-46df-ae22-96d66680d8f3 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:30:56.496093 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-01b56af5-9ac1-46df-ae22-96d66680d8f3 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/77d18a34-ad63-453f-9b17-517bd85a6f42" status: 200 len: 1515 microversion: 2.1 time: 0.162440 Jun 07 09:30:56.496679 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 202/404] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:30:56 2022] GET /compute/v2.1/servers/77d18a34-ad63-453f-9b17-517bd85a6f42 => generated 1515 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:30:59.197120 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-2b688c0f-8d61-4dc6-a4d0-20bc6a480cc7 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Action: 'create', calling method: .version_select at 0x7f5c928b6ee0>, body: {"keypair": {"name": "tempest-keypair-1423175716", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCDT9afNvJiXlTYKXTU/aG0yfFaT/miE3Imo+QE6wqVfsnPxPCqYUc5GdyJFLZwBDsFyEyYa8QaI1lcYeqKypLy9ytyvITDmgCt650+UVKfw6mqzuJelMyREMzK5NXHMQA=="}} {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:30:59.210918 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.quota [None req-2b688c0f-8d61-4dc6-a4d0-20bc6a480cc7 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Getting quotas for project 856d592872fa47a2b628f1c3e482b2fd. Resources: {'key_pairs'} {{(pid=118741) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 09:30:59.214902 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.quota [None req-2b688c0f-8d61-4dc6-a4d0-20bc6a480cc7 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Getting quotas for user 75f6d2e28f024875bda0b20f751bdf0d and project 856d592872fa47a2b628f1c3e482b2fd. Resources: {'key_pairs'} {{(pid=118741) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 09:30:59.327656 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-2b688c0f-8d61-4dc6-a4d0-20bc6a480cc7 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.134095 Jun 07 09:30:59.328152 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 203/405] 10.222.0.57 () {60 vars in 1158 bytes} [Tue Jun 7 09:30:59 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:31:02.056990 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-336f74c5-cf0c-4431-8fde-40458417f075 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-986291299", "imageRef": "8fdb0275-8c58-4c9e-a2f3-3aae3a947526", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "45cdfca3-81fe-4f60-a7ce-397cbd865f9d"}], "security_groups": [{"name": "tempest-securitygroup--1694573962"}], "key_name": "tempest-keypair-1423175716", "user_data": "}} {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:31:02.159568 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.network.neutron [None req-336f74c5-cf0c-4431-8fde-40458417f075 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] validate_networks() for [('45cdfca3-81fe-4f60-a7ce-397cbd865f9d', None, None, None, None, None)] {{(pid=118740) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 09:31:02.541519 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.virt.hardware [None req-336f74c5-cf0c-4431-8fde-40458417f075 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Flavor limits 0:0:0 {{(pid=118740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 09:31:02.541935 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.virt.hardware [None req-336f74c5-cf0c-4431-8fde-40458417f075 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Image limits 0:0:0 {{(pid=118740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 09:31:02.542420 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.virt.hardware [None req-336f74c5-cf0c-4431-8fde-40458417f075 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Flavor pref 0:0:0 {{(pid=118740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 09:31:02.542821 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.virt.hardware [None req-336f74c5-cf0c-4431-8fde-40458417f075 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Image pref 0:0:0 {{(pid=118740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 09:31:02.543226 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.virt.hardware [None req-336f74c5-cf0c-4431-8fde-40458417f075 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 09:31:02.551858 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-336f74c5-cf0c-4431-8fde-40458417f075 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:02.552301 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-336f74c5-cf0c-4431-8fde-40458417f075 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:02.553122 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-336f74c5-cf0c-4431-8fde-40458417f075 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:02.553551 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-336f74c5-cf0c-4431-8fde-40458417f075 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:02.570746 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.quota [None req-336f74c5-cf0c-4431-8fde-40458417f075 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Getting quotas for project 856d592872fa47a2b628f1c3e482b2fd. Resources: {'instances', 'cores', 'ram'} {{(pid=118740) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 09:31:02.575184 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.quota [None req-336f74c5-cf0c-4431-8fde-40458417f075 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Getting quotas for user 75f6d2e28f024875bda0b20f751bdf0d and project 856d592872fa47a2b628f1c3e482b2fd. Resources: {'instances', 'cores', 'ram'} {{(pid=118740) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 09:31:02.586881 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-336f74c5-cf0c-4431-8fde-40458417f075 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Going to run 1 instances... {{(pid=118740) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 09:31:02.589199 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-336f74c5-cf0c-4431-8fde-40458417f075 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8b9ef09-4309-4fb4-86c8-1f7499c44e75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8fdb0275-8c58-4c9e-a2f3-3aae3a947526',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118740) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 09:31:02.728562 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-336f74c5-cf0c-4431-8fde-40458417f075 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.676220 Jun 07 09:31:02.730016 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 203/406] 10.222.0.57 () {60 vars in 1146 bytes} [Tue Jun 7 09:31:02 2022] POST /compute/v2.1/servers => generated 409 bytes in 678 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 07 09:31:02.740651 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-f858d42d-9e3e-4f41-936c-fae8c0c6b317 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:31:02.741373 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-f858d42d-9e3e-4f41-936c-fae8c0c6b317 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8b9ef09-4309-4fb4-86c8-1f7499c44e75] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:31:02.815463 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-f858d42d-9e3e-4f41-936c-fae8c0c6b317 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:02.822432 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-f858d42d-9e3e-4f41-936c-fae8c0c6b317 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75" status: 200 len: 1245 microversion: 2.1 time: 0.085921 Jun 07 09:31:02.832628 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 204/407] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:31:02 2022] GET /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75 => generated 1245 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:31:03.839226 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-e27fc357-3218-4e51-8e0a-3322509a1cc6 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:31:03.839835 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-e27fc357-3218-4e51-8e0a-3322509a1cc6 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8b9ef09-4309-4fb4-86c8-1f7499c44e75] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:31:03.846990 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-e27fc357-3218-4e51-8e0a-3322509a1cc6 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:03.847442 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-e27fc357-3218-4e51-8e0a-3322509a1cc6 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:03.848333 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-e27fc357-3218-4e51-8e0a-3322509a1cc6 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:03.848708 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-e27fc357-3218-4e51-8e0a-3322509a1cc6 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:03.914253 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-e27fc357-3218-4e51-8e0a-3322509a1cc6 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:03.922256 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-e27fc357-3218-4e51-8e0a-3322509a1cc6 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75" status: 200 len: 1249 microversion: 2.1 time: 0.086992 Jun 07 09:31:03.922810 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 204/408] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:31:03 2022] GET /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75 => generated 1249 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:31:04.939653 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-a8936147-96fe-489e-98f7-859743aa8ed8 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:31:04.940260 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-a8936147-96fe-489e-98f7-859743aa8ed8 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8b9ef09-4309-4fb4-86c8-1f7499c44e75] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:31:04.947249 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-a8936147-96fe-489e-98f7-859743aa8ed8 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:04.947698 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-a8936147-96fe-489e-98f7-859743aa8ed8 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:04.948460 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-a8936147-96fe-489e-98f7-859743aa8ed8 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:04.948934 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-a8936147-96fe-489e-98f7-859743aa8ed8 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:05.008607 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-a8936147-96fe-489e-98f7-859743aa8ed8 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:05.017445 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-a8936147-96fe-489e-98f7-859743aa8ed8 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75" status: 200 len: 1297 microversion: 2.1 time: 0.081666 Jun 07 09:31:05.018389 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 205/409] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:31:04 2022] GET /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75 => generated 1297 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:31:06.037311 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-30d7fb64-3ef3-416b-9098-dc1029b6461b tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:31:06.038716 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-30d7fb64-3ef3-416b-9098-dc1029b6461b tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8b9ef09-4309-4fb4-86c8-1f7499c44e75] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:31:06.047693 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-30d7fb64-3ef3-416b-9098-dc1029b6461b tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:06.048487 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-30d7fb64-3ef3-416b-9098-dc1029b6461b tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:06.049435 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-30d7fb64-3ef3-416b-9098-dc1029b6461b tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:06.058800 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-30d7fb64-3ef3-416b-9098-dc1029b6461b tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:06.245807 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-30d7fb64-3ef3-416b-9098-dc1029b6461b tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:06.254164 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-30d7fb64-3ef3-416b-9098-dc1029b6461b tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75" status: 200 len: 1371 microversion: 2.1 time: 0.220935 Jun 07 09:31:06.254777 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 205/410] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:31:06 2022] GET /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75 => generated 1371 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:31:07.114219 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [req-fe04dee5-3601-4194-aec3-6b075042bcd2 req-9c99edb0-4578-475a-bbed-d10f99e88d09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8b9ef09-4309-4fb4-86c8-1f7499c44e75", "tag": "bb463c81-6e35-47ee-93de-84862189b305"}]} {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:31:07.117511 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:31:07.122822 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [req-fe04dee5-3601-4194-aec3-6b075042bcd2 req-9c99edb0-4578-475a-bbed-d10f99e88d09 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:07.123473 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [req-fe04dee5-3601-4194-aec3-6b075042bcd2 req-9c99edb0-4578-475a-bbed-d10f99e88d09 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:07.131842 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:31:07.140353 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.compute.server_external_events [req-fe04dee5-3601-4194-aec3-6b075042bcd2 req-9c99edb0-4578-475a-bbed-d10f99e88d09 service nova] Creating event network-changed:bb463c81-6e35-47ee-93de-84862189b305 for instance a8b9ef09-4309-4fb4-86c8-1f7499c44e75 on hv-cinder-83699 Jun 07 09:31:07.145528 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [req-fe04dee5-3601-4194-aec3-6b075042bcd2 req-9c99edb0-4578-475a-bbed-d10f99e88d09 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035294 Jun 07 09:31:07.146320 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 206/411] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Jun 7 09:31:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:31:07.275925 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-591e7529-2e92-4e7a-a4b5-8e13d89e3f04 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:31:07.277209 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-591e7529-2e92-4e7a-a4b5-8e13d89e3f04 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8b9ef09-4309-4fb4-86c8-1f7499c44e75] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:31:07.291242 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-591e7529-2e92-4e7a-a4b5-8e13d89e3f04 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:07.291756 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-591e7529-2e92-4e7a-a4b5-8e13d89e3f04 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:07.292574 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-591e7529-2e92-4e7a-a4b5-8e13d89e3f04 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:07.293073 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-591e7529-2e92-4e7a-a4b5-8e13d89e3f04 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:07.426099 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-591e7529-2e92-4e7a-a4b5-8e13d89e3f04 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:07.433810 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-591e7529-2e92-4e7a-a4b5-8e13d89e3f04 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75" status: 200 len: 1371 microversion: 2.1 time: 0.165355 Jun 07 09:31:07.434406 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 206/412] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:31:07 2022] GET /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75 => generated 1371 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:31:08.452159 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-f6f05451-6381-4768-9145-dc4dc34db6e1 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:31:08.452872 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-f6f05451-6381-4768-9145-dc4dc34db6e1 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8b9ef09-4309-4fb4-86c8-1f7499c44e75] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:31:08.460290 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-f6f05451-6381-4768-9145-dc4dc34db6e1 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:08.460751 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-f6f05451-6381-4768-9145-dc4dc34db6e1 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:08.461495 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-f6f05451-6381-4768-9145-dc4dc34db6e1 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:08.461998 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-f6f05451-6381-4768-9145-dc4dc34db6e1 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:08.588547 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-f6f05451-6381-4768-9145-dc4dc34db6e1 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:08.596635 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-f6f05451-6381-4768-9145-dc4dc34db6e1 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75" status: 200 len: 1371 microversion: 2.1 time: 0.149125 Jun 07 09:31:08.597209 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 207/413] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:31:08 2022] GET /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75 => generated 1371 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:31:09.239739 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-313875f6-0e40-42d8-82da-12844a28b8ce tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-127049131", "imageRef": "8fdb0275-8c58-4c9e-a2f3-3aae3a947526", "flavorRef": "452", "networks": [{"uuid": "0d188b8a-be5b-4676-82e6-d01c947766fd"}]}} {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:31:09.290533 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.network.neutron [None req-313875f6-0e40-42d8-82da-12844a28b8ce tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] validate_networks() for [('0d188b8a-be5b-4676-82e6-d01c947766fd', None, None, None, None, None)] {{(pid=118740) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 09:31:09.613204 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-b8e2b941-464a-4fdf-abcc-b3a0988a3458 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:31:09.613804 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-b8e2b941-464a-4fdf-abcc-b3a0988a3458 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8b9ef09-4309-4fb4-86c8-1f7499c44e75] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:31:09.619889 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b8e2b941-464a-4fdf-abcc-b3a0988a3458 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:09.620539 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b8e2b941-464a-4fdf-abcc-b3a0988a3458 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:09.621133 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b8e2b941-464a-4fdf-abcc-b3a0988a3458 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:09.621571 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b8e2b941-464a-4fdf-abcc-b3a0988a3458 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:09.628571 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.virt.hardware [None req-313875f6-0e40-42d8-82da-12844a28b8ce tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Flavor limits 0:0:0 {{(pid=118740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 09:31:09.629008 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.virt.hardware [None req-313875f6-0e40-42d8-82da-12844a28b8ce tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Image limits 0:0:0 {{(pid=118740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 09:31:09.629473 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.virt.hardware [None req-313875f6-0e40-42d8-82da-12844a28b8ce tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Flavor pref 0:0:0 {{(pid=118740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 09:31:09.629873 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.virt.hardware [None req-313875f6-0e40-42d8-82da-12844a28b8ce tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Image pref 0:0:0 {{(pid=118740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 09:31:09.630277 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.virt.hardware [None req-313875f6-0e40-42d8-82da-12844a28b8ce tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 09:31:09.638933 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-313875f6-0e40-42d8-82da-12844a28b8ce tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:09.640014 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-313875f6-0e40-42d8-82da-12844a28b8ce tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:09.640909 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-313875f6-0e40-42d8-82da-12844a28b8ce tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:09.641252 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-313875f6-0e40-42d8-82da-12844a28b8ce tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:09.662535 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.quota [None req-313875f6-0e40-42d8-82da-12844a28b8ce tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Getting quotas for project 76e471342cb24c918197b538b2c8642a. Resources: {'instances', 'cores', 'ram'} {{(pid=118740) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 09:31:09.666466 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.quota [None req-313875f6-0e40-42d8-82da-12844a28b8ce tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Getting quotas for user 7ae6107c814c4bb5a36ba9e80ef875f4 and project 76e471342cb24c918197b538b2c8642a. Resources: {'instances', 'cores', 'ram'} {{(pid=118740) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 09:31:09.677505 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-313875f6-0e40-42d8-82da-12844a28b8ce tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Going to run 1 instances... {{(pid=118740) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 09:31:09.679607 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-313875f6-0e40-42d8-82da-12844a28b8ce tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] [instance: 7a3d7164-abc0-4d4a-89f5-dfd30c29baf8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8fdb0275-8c58-4c9e-a2f3-3aae3a947526',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118740) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 09:31:09.757811 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-b8e2b941-464a-4fdf-abcc-b3a0988a3458 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:09.765902 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-b8e2b941-464a-4fdf-abcc-b3a0988a3458 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75" status: 200 len: 1371 microversion: 2.1 time: 0.156468 Jun 07 09:31:09.766451 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 208/414] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:31:09 2022] GET /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75 => generated 1371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:31:09.861428 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-313875f6-0e40-42d8-82da-12844a28b8ce tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.625395 Jun 07 09:31:09.862156 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 207/415] 10.222.0.57 () {60 vars in 1146 bytes} [Tue Jun 7 09:31:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 627 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 09:31:09.872082 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-5d30418f-cc3c-439a-8662-a8c1cd5e4a48 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:31:09.872722 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-5d30418f-cc3c-439a-8662-a8c1cd5e4a48 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] [instance: 7a3d7164-abc0-4d4a-89f5-dfd30c29baf8] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:31:09.925158 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-5d30418f-cc3c-439a-8662-a8c1cd5e4a48 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae6107c814c4bb5a36ba9e80ef875f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e471342cb24c918197b538b2c8642a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:09.931886 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-5d30418f-cc3c-439a-8662-a8c1cd5e4a48 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] 10.222.0.57 "GET /compute/v2.1/servers/7a3d7164-abc0-4d4a-89f5-dfd30c29baf8" status: 200 len: 1213 microversion: 2.1 time: 0.063621 Jun 07 09:31:09.932458 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 209/416] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:31:09 2022] GET /compute/v2.1/servers/7a3d7164-abc0-4d4a-89f5-dfd30c29baf8 => generated 1213 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:31:10.783610 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-121968e0-d8e0-486b-8f43-25b3f623560e tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:31:10.784226 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-121968e0-d8e0-486b-8f43-25b3f623560e tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8b9ef09-4309-4fb4-86c8-1f7499c44e75] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:31:10.791041 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-121968e0-d8e0-486b-8f43-25b3f623560e tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:10.791493 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-121968e0-d8e0-486b-8f43-25b3f623560e tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:10.792266 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-121968e0-d8e0-486b-8f43-25b3f623560e tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:10.792735 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-121968e0-d8e0-486b-8f43-25b3f623560e tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:10.921834 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-121968e0-d8e0-486b-8f43-25b3f623560e tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:10.929387 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-121968e0-d8e0-486b-8f43-25b3f623560e tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75" status: 200 len: 1371 microversion: 2.1 time: 0.150877 Jun 07 09:31:10.930161 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 208/417] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:31:10 2022] GET /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75 => generated 1371 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:31:10.949295 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-61b385d0-0fbf-4bb5-b7ab-789703d6c6bf tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:31:10.949898 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-61b385d0-0fbf-4bb5-b7ab-789703d6c6bf tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] [instance: 7a3d7164-abc0-4d4a-89f5-dfd30c29baf8] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:31:10.956326 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-61b385d0-0fbf-4bb5-b7ab-789703d6c6bf tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:10.956809 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-61b385d0-0fbf-4bb5-b7ab-789703d6c6bf tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:10.960530 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-61b385d0-0fbf-4bb5-b7ab-789703d6c6bf tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:10.960530 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-61b385d0-0fbf-4bb5-b7ab-789703d6c6bf tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:11.017804 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-61b385d0-0fbf-4bb5-b7ab-789703d6c6bf tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae6107c814c4bb5a36ba9e80ef875f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e471342cb24c918197b538b2c8642a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:11.025841 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-61b385d0-0fbf-4bb5-b7ab-789703d6c6bf tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] 10.222.0.57 "GET /compute/v2.1/servers/7a3d7164-abc0-4d4a-89f5-dfd30c29baf8" status: 200 len: 1217 microversion: 2.1 time: 0.080336 Jun 07 09:31:11.026408 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 210/418] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:31:10 2022] GET /compute/v2.1/servers/7a3d7164-abc0-4d4a-89f5-dfd30c29baf8 => generated 1217 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:31:11.946283 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-1e07eca8-d2b3-4b52-bdc5-3fe7f94a01c0 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:31:11.946900 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-1e07eca8-d2b3-4b52-bdc5-3fe7f94a01c0 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8b9ef09-4309-4fb4-86c8-1f7499c44e75] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:31:11.954216 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-1e07eca8-d2b3-4b52-bdc5-3fe7f94a01c0 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:11.954667 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-1e07eca8-d2b3-4b52-bdc5-3fe7f94a01c0 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:11.955430 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-1e07eca8-d2b3-4b52-bdc5-3fe7f94a01c0 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:11.955869 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-1e07eca8-d2b3-4b52-bdc5-3fe7f94a01c0 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:12.042570 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-7c56574f-ac7b-45b7-83ba-2d545cc9145d tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:31:12.043180 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-7c56574f-ac7b-45b7-83ba-2d545cc9145d tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] [instance: 7a3d7164-abc0-4d4a-89f5-dfd30c29baf8] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:31:12.049261 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-7c56574f-ac7b-45b7-83ba-2d545cc9145d tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:12.049709 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-7c56574f-ac7b-45b7-83ba-2d545cc9145d tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:12.050467 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-7c56574f-ac7b-45b7-83ba-2d545cc9145d tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:12.050905 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-7c56574f-ac7b-45b7-83ba-2d545cc9145d tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:12.087320 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-1e07eca8-d2b3-4b52-bdc5-3fe7f94a01c0 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:12.095735 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-1e07eca8-d2b3-4b52-bdc5-3fe7f94a01c0 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75" status: 200 len: 1371 microversion: 2.1 time: 0.153275 Jun 07 09:31:12.096308 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 209/419] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:31:11 2022] GET /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75 => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:31:12.113478 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-7c56574f-ac7b-45b7-83ba-2d545cc9145d tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae6107c814c4bb5a36ba9e80ef875f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e471342cb24c918197b538b2c8642a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:12.120919 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-7c56574f-ac7b-45b7-83ba-2d545cc9145d tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] 10.222.0.57 "GET /compute/v2.1/servers/7a3d7164-abc0-4d4a-89f5-dfd30c29baf8" status: 200 len: 1217 microversion: 2.1 time: 0.082099 Jun 07 09:31:12.121471 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 211/420] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:31:12 2022] GET /compute/v2.1/servers/7a3d7164-abc0-4d4a-89f5-dfd30c29baf8 => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:31:13.113211 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-c9c5b35e-d6d8-4386-98aa-dab07c3ae48b tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:31:13.113823 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-c9c5b35e-d6d8-4386-98aa-dab07c3ae48b tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8b9ef09-4309-4fb4-86c8-1f7499c44e75] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:31:13.116153 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=6 {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:31:13.120908 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-c9c5b35e-d6d8-4386-98aa-dab07c3ae48b tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:13.121371 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-c9c5b35e-d6d8-4386-98aa-dab07c3ae48b tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:13.122095 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-c9c5b35e-d6d8-4386-98aa-dab07c3ae48b tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:13.122525 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-c9c5b35e-d6d8-4386-98aa-dab07c3ae48b tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:13.138054 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-022b4063-fdaa-4a9c-805c-77ceadd1e98f tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:31:13.138767 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-022b4063-fdaa-4a9c-805c-77ceadd1e98f tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] [instance: 7a3d7164-abc0-4d4a-89f5-dfd30c29baf8] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:31:13.145032 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-022b4063-fdaa-4a9c-805c-77ceadd1e98f tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:13.145560 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-022b4063-fdaa-4a9c-805c-77ceadd1e98f tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:13.146392 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-022b4063-fdaa-4a9c-805c-77ceadd1e98f tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:13.146895 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-022b4063-fdaa-4a9c-805c-77ceadd1e98f tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:13.206998 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-022b4063-fdaa-4a9c-805c-77ceadd1e98f tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae6107c814c4bb5a36ba9e80ef875f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e471342cb24c918197b538b2c8642a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:13.214523 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-022b4063-fdaa-4a9c-805c-77ceadd1e98f tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] 10.222.0.57 "GET /compute/v2.1/servers/7a3d7164-abc0-4d4a-89f5-dfd30c29baf8" status: 200 len: 1265 microversion: 2.1 time: 0.080322 Jun 07 09:31:13.215090 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 212/421] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:31:13 2022] GET /compute/v2.1/servers/7a3d7164-abc0-4d4a-89f5-dfd30c29baf8 => generated 1265 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:31:13.251931 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-c9c5b35e-d6d8-4386-98aa-dab07c3ae48b tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:13.259241 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-c9c5b35e-d6d8-4386-98aa-dab07c3ae48b tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75" status: 200 len: 1371 microversion: 2.1 time: 0.150074 Jun 07 09:31:13.259800 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 210/422] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:31:13 2022] GET /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75 => generated 1371 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:31:14.236554 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-e18ae565-14ff-406a-86fe-4c27460871a2 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:31:14.237203 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-e18ae565-14ff-406a-86fe-4c27460871a2 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] [instance: 7a3d7164-abc0-4d4a-89f5-dfd30c29baf8] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:31:14.243448 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-e18ae565-14ff-406a-86fe-4c27460871a2 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:14.243904 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-e18ae565-14ff-406a-86fe-4c27460871a2 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:14.244692 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-e18ae565-14ff-406a-86fe-4c27460871a2 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:14.245142 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-e18ae565-14ff-406a-86fe-4c27460871a2 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:14.275556 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-c40186b8-7de5-44bc-b567-8afcfe4524c5 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:31:14.276159 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-c40186b8-7de5-44bc-b567-8afcfe4524c5 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8b9ef09-4309-4fb4-86c8-1f7499c44e75] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:31:14.283026 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-c40186b8-7de5-44bc-b567-8afcfe4524c5 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:14.283483 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-c40186b8-7de5-44bc-b567-8afcfe4524c5 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:14.284258 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-c40186b8-7de5-44bc-b567-8afcfe4524c5 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:14.284726 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-c40186b8-7de5-44bc-b567-8afcfe4524c5 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:14.311570 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-e18ae565-14ff-406a-86fe-4c27460871a2 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae6107c814c4bb5a36ba9e80ef875f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e471342cb24c918197b538b2c8642a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:14.318498 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-e18ae565-14ff-406a-86fe-4c27460871a2 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] 10.222.0.57 "GET /compute/v2.1/servers/7a3d7164-abc0-4d4a-89f5-dfd30c29baf8" status: 200 len: 1271 microversion: 2.1 time: 0.086040 Jun 07 09:31:14.319063 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 213/423] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:31:14 2022] GET /compute/v2.1/servers/7a3d7164-abc0-4d4a-89f5-dfd30c29baf8 => generated 1271 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:31:14.422355 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-c40186b8-7de5-44bc-b567-8afcfe4524c5 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:14.430398 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-c40186b8-7de5-44bc-b567-8afcfe4524c5 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75" status: 200 len: 1371 microversion: 2.1 time: 0.159135 Jun 07 09:31:14.431058 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 211/424] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:31:14 2022] GET /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75 => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:31:15.199102 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [req-bb6e66c7-ea99-42b2-b3da-d6bec32f96f4 req-0b769c21-8e6e-4772-839b-56e19527cbe9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8b9ef09-4309-4fb4-86c8-1f7499c44e75", "name": "network-vif-plugged", "status": "completed", "tag": "bb463c81-6e35-47ee-93de-84862189b305"}]} {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:31:15.207841 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [req-bb6e66c7-ea99-42b2-b3da-d6bec32f96f4 req-0b769c21-8e6e-4772-839b-56e19527cbe9 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:15.208383 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [req-bb6e66c7-ea99-42b2-b3da-d6bec32f96f4 req-0b769c21-8e6e-4772-839b-56e19527cbe9 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:15.219732 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.compute.server_external_events [req-bb6e66c7-ea99-42b2-b3da-d6bec32f96f4 req-0b769c21-8e6e-4772-839b-56e19527cbe9 service nova] Creating event network-vif-plugged:bb463c81-6e35-47ee-93de-84862189b305 for instance a8b9ef09-4309-4fb4-86c8-1f7499c44e75 on hv-cinder-83699 Jun 07 09:31:15.224927 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [req-bb6e66c7-ea99-42b2-b3da-d6bec32f96f4 req-0b769c21-8e6e-4772-839b-56e19527cbe9 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030101 Jun 07 09:31:15.225516 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 214/425] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Jun 7 09:31:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:31:15.335232 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-b53bc6e6-42e6-4a12-a297-2f0a1675102c tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:31:15.335761 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-b53bc6e6-42e6-4a12-a297-2f0a1675102c tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] [instance: 7a3d7164-abc0-4d4a-89f5-dfd30c29baf8] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:31:15.342583 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b53bc6e6-42e6-4a12-a297-2f0a1675102c tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:15.343145 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b53bc6e6-42e6-4a12-a297-2f0a1675102c tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:15.343904 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b53bc6e6-42e6-4a12-a297-2f0a1675102c tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:15.344344 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b53bc6e6-42e6-4a12-a297-2f0a1675102c tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:15.447952 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-c84d7866-4114-4b43-b7f9-235507d8a366 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:31:15.458184 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-c84d7866-4114-4b43-b7f9-235507d8a366 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8b9ef09-4309-4fb4-86c8-1f7499c44e75] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:31:15.458184 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-c84d7866-4114-4b43-b7f9-235507d8a366 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:15.458184 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-c84d7866-4114-4b43-b7f9-235507d8a366 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:15.458184 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-c84d7866-4114-4b43-b7f9-235507d8a366 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:15.458520 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-c84d7866-4114-4b43-b7f9-235507d8a366 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:15.493313 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-b53bc6e6-42e6-4a12-a297-2f0a1675102c tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae6107c814c4bb5a36ba9e80ef875f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e471342cb24c918197b538b2c8642a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:15.501098 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-b53bc6e6-42e6-4a12-a297-2f0a1675102c tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] 10.222.0.57 "GET /compute/v2.1/servers/7a3d7164-abc0-4d4a-89f5-dfd30c29baf8" status: 200 len: 1313 microversion: 2.1 time: 0.169757 Jun 07 09:31:15.501889 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 212/426] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:31:15 2022] GET /compute/v2.1/servers/7a3d7164-abc0-4d4a-89f5-dfd30c29baf8 => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:31:15.506685 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [req-3d5cec1f-2d55-4eba-a390-93ef44fa0671 req-4be10fab-f0ba-447f-8e6a-1e806f4a9c7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a3d7164-abc0-4d4a-89f5-dfd30c29baf8", "tag": "30ccf474-d769-4221-8975-1481ddd95c25"}]} {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:31:15.514533 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [req-3d5cec1f-2d55-4eba-a390-93ef44fa0671 req-4be10fab-f0ba-447f-8e6a-1e806f4a9c7a service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:15.515006 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [req-3d5cec1f-2d55-4eba-a390-93ef44fa0671 req-4be10fab-f0ba-447f-8e6a-1e806f4a9c7a service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:15.525668 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.compute.server_external_events [req-3d5cec1f-2d55-4eba-a390-93ef44fa0671 req-4be10fab-f0ba-447f-8e6a-1e806f4a9c7a service nova] Creating event network-changed:30ccf474-d769-4221-8975-1481ddd95c25 for instance 7a3d7164-abc0-4d4a-89f5-dfd30c29baf8 on hv-cinder-83699 Jun 07 09:31:15.531632 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [req-3d5cec1f-2d55-4eba-a390-93ef44fa0671 req-4be10fab-f0ba-447f-8e6a-1e806f4a9c7a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028157 Jun 07 09:31:15.532439 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 213/427] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Jun 7 09:31:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:31:15.603870 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-c84d7866-4114-4b43-b7f9-235507d8a366 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:15.612465 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-c84d7866-4114-4b43-b7f9-235507d8a366 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75" status: 200 len: 1371 microversion: 2.1 time: 0.168803 Jun 07 09:31:15.613095 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 215/428] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:31:15 2022] GET /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75 => generated 1371 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:31:16.520226 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-155fa5d9-f84d-4622-9b8e-501baccea022 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:31:16.522704 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-155fa5d9-f84d-4622-9b8e-501baccea022 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] [instance: 7a3d7164-abc0-4d4a-89f5-dfd30c29baf8] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:31:16.527282 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-155fa5d9-f84d-4622-9b8e-501baccea022 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:16.527735 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-155fa5d9-f84d-4622-9b8e-501baccea022 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:16.528496 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-155fa5d9-f84d-4622-9b8e-501baccea022 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:16.528964 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-155fa5d9-f84d-4622-9b8e-501baccea022 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:16.630924 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-17816364-68c0-4cbf-9dbe-cc946801b397 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:31:16.632240 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-17816364-68c0-4cbf-9dbe-cc946801b397 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8b9ef09-4309-4fb4-86c8-1f7499c44e75] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:31:16.640148 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-17816364-68c0-4cbf-9dbe-cc946801b397 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:16.640941 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-17816364-68c0-4cbf-9dbe-cc946801b397 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:16.641603 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-17816364-68c0-4cbf-9dbe-cc946801b397 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:16.642040 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-17816364-68c0-4cbf-9dbe-cc946801b397 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:16.660073 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-155fa5d9-f84d-4622-9b8e-501baccea022 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae6107c814c4bb5a36ba9e80ef875f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e471342cb24c918197b538b2c8642a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:16.667716 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-155fa5d9-f84d-4622-9b8e-501baccea022 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] 10.222.0.57 "GET /compute/v2.1/servers/7a3d7164-abc0-4d4a-89f5-dfd30c29baf8" status: 200 len: 1313 microversion: 2.1 time: 0.152320 Jun 07 09:31:16.668285 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 214/429] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:31:16 2022] GET /compute/v2.1/servers/7a3d7164-abc0-4d4a-89f5-dfd30c29baf8 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:31:16.774345 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-17816364-68c0-4cbf-9dbe-cc946801b397 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:16.782229 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-17816364-68c0-4cbf-9dbe-cc946801b397 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75" status: 200 len: 1371 microversion: 2.1 time: 0.157209 Jun 07 09:31:16.783109 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 216/430] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:31:16 2022] GET /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75 => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:31:17.684349 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-e115388e-be21-4926-9abf-e8291d921853 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:31:17.685017 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-e115388e-be21-4926-9abf-e8291d921853 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] [instance: 7a3d7164-abc0-4d4a-89f5-dfd30c29baf8] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:31:17.691926 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-e115388e-be21-4926-9abf-e8291d921853 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:17.692362 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-e115388e-be21-4926-9abf-e8291d921853 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:17.693155 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-e115388e-be21-4926-9abf-e8291d921853 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:17.693618 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-e115388e-be21-4926-9abf-e8291d921853 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:17.799068 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-6ff35a51-7190-4193-9346-d3290783dc72 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:31:17.800046 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-6ff35a51-7190-4193-9346-d3290783dc72 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8b9ef09-4309-4fb4-86c8-1f7499c44e75] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:31:17.813459 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-6ff35a51-7190-4193-9346-d3290783dc72 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:17.814016 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-6ff35a51-7190-4193-9346-d3290783dc72 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:17.814786 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-6ff35a51-7190-4193-9346-d3290783dc72 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:17.815221 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-6ff35a51-7190-4193-9346-d3290783dc72 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:17.819493 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-e115388e-be21-4926-9abf-e8291d921853 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae6107c814c4bb5a36ba9e80ef875f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e471342cb24c918197b538b2c8642a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:17.827584 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-e115388e-be21-4926-9abf-e8291d921853 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] 10.222.0.57 "GET /compute/v2.1/servers/7a3d7164-abc0-4d4a-89f5-dfd30c29baf8" status: 200 len: 1313 microversion: 2.1 time: 0.147017 Jun 07 09:31:17.828147 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 215/431] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:31:17 2022] GET /compute/v2.1/servers/7a3d7164-abc0-4d4a-89f5-dfd30c29baf8 => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:31:17.946665 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-6ff35a51-7190-4193-9346-d3290783dc72 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:17.954752 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-6ff35a51-7190-4193-9346-d3290783dc72 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75" status: 200 len: 1565 microversion: 2.1 time: 0.159704 Jun 07 09:31:17.955315 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 217/432] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:31:17 2022] GET /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75 => generated 1565 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:31:17.970952 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-26aaaf8e-8fb2-42a5-bee5-a8e7d380a2a3 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:31:17.971443 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-26aaaf8e-8fb2-42a5-bee5-a8e7d380a2a3 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8b9ef09-4309-4fb4-86c8-1f7499c44e75] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:31:17.977365 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-26aaaf8e-8fb2-42a5-bee5-a8e7d380a2a3 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:17.977829 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-26aaaf8e-8fb2-42a5-bee5-a8e7d380a2a3 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:17.978569 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-26aaaf8e-8fb2-42a5-bee5-a8e7d380a2a3 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:17.979006 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-26aaaf8e-8fb2-42a5-bee5-a8e7d380a2a3 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:18.058466 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-26aaaf8e-8fb2-42a5-bee5-a8e7d380a2a3 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091247 Jun 07 09:31:18.059055 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 216/433] 10.222.0.57 () {58 vars in 1274 bytes} [Tue Jun 7 09:31:17 2022] GET /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:31:18.845455 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-37955e3d-6d33-4128-92e6-9590a64a0038 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:31:18.846596 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-37955e3d-6d33-4128-92e6-9590a64a0038 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] [instance: 7a3d7164-abc0-4d4a-89f5-dfd30c29baf8] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:31:18.852852 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-37955e3d-6d33-4128-92e6-9590a64a0038 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:18.853302 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-37955e3d-6d33-4128-92e6-9590a64a0038 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:18.854340 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-37955e3d-6d33-4128-92e6-9590a64a0038 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:18.854548 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-37955e3d-6d33-4128-92e6-9590a64a0038 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:19.004771 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-37955e3d-6d33-4128-92e6-9590a64a0038 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae6107c814c4bb5a36ba9e80ef875f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e471342cb24c918197b538b2c8642a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:19.012881 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-37955e3d-6d33-4128-92e6-9590a64a0038 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] 10.222.0.57 "GET /compute/v2.1/servers/7a3d7164-abc0-4d4a-89f5-dfd30c29baf8" status: 200 len: 1313 microversion: 2.1 time: 0.171949 Jun 07 09:31:19.016630 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 218/434] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:31:18 2022] GET /compute/v2.1/servers/7a3d7164-abc0-4d4a-89f5-dfd30c29baf8 => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:31:19.216872 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [req-2a9eb874-54fb-48a1-a37c-e90167b7208e req-cd9e3eab-9d8b-41b2-8793-b168b60ef67e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8b9ef09-4309-4fb4-86c8-1f7499c44e75", "tag": "bb463c81-6e35-47ee-93de-84862189b305"}]} {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:31:19.225140 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [req-2a9eb874-54fb-48a1-a37c-e90167b7208e req-cd9e3eab-9d8b-41b2-8793-b168b60ef67e service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:19.225585 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [req-2a9eb874-54fb-48a1-a37c-e90167b7208e req-cd9e3eab-9d8b-41b2-8793-b168b60ef67e service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:19.236936 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.compute.server_external_events [req-2a9eb874-54fb-48a1-a37c-e90167b7208e req-cd9e3eab-9d8b-41b2-8793-b168b60ef67e service nova] Creating event network-changed:bb463c81-6e35-47ee-93de-84862189b305 for instance a8b9ef09-4309-4fb4-86c8-1f7499c44e75 on hv-cinder-83699 Jun 07 09:31:19.242024 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [req-2a9eb874-54fb-48a1-a37c-e90167b7208e req-cd9e3eab-9d8b-41b2-8793-b168b60ef67e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029738 Jun 07 09:31:19.242609 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 217/435] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Jun 7 09:31:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:31:20.029664 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-1a22935b-3373-4692-8cc0-c0a4e6720736 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:31:20.030282 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-1a22935b-3373-4692-8cc0-c0a4e6720736 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] [instance: 7a3d7164-abc0-4d4a-89f5-dfd30c29baf8] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:31:20.032573 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writing DB stats nova_cell0:SELECT=8 {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:31:20.037771 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-1a22935b-3373-4692-8cc0-c0a4e6720736 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:20.038222 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-1a22935b-3373-4692-8cc0-c0a4e6720736 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:20.038987 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-1a22935b-3373-4692-8cc0-c0a4e6720736 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:20.039564 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-1a22935b-3373-4692-8cc0-c0a4e6720736 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:20.173714 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-1a22935b-3373-4692-8cc0-c0a4e6720736 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae6107c814c4bb5a36ba9e80ef875f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e471342cb24c918197b538b2c8642a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:20.181134 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-1a22935b-3373-4692-8cc0-c0a4e6720736 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] 10.222.0.57 "GET /compute/v2.1/servers/7a3d7164-abc0-4d4a-89f5-dfd30c29baf8" status: 200 len: 1313 microversion: 2.1 time: 0.155491 Jun 07 09:31:20.181697 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 219/436] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:31:20 2022] GET /compute/v2.1/servers/7a3d7164-abc0-4d4a-89f5-dfd30c29baf8 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:31:21.198671 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-a0b499bc-8397-4924-ac09-ce7817f23f57 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:31:21.199601 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-a0b499bc-8397-4924-ac09-ce7817f23f57 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] [instance: 7a3d7164-abc0-4d4a-89f5-dfd30c29baf8] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:31:21.203187 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writing DB stats nova_cell0:SELECT=4 {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:31:21.204344 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writing DB stats nova_cell0:SELECT=12 {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:31:21.209010 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-a0b499bc-8397-4924-ac09-ce7817f23f57 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:21.209455 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-a0b499bc-8397-4924-ac09-ce7817f23f57 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:21.210237 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-a0b499bc-8397-4924-ac09-ce7817f23f57 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:21.210666 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-a0b499bc-8397-4924-ac09-ce7817f23f57 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:21.213947 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writing DB stats nova_cell1:SELECT=100 {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:31:21.348830 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-a0b499bc-8397-4924-ac09-ce7817f23f57 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae6107c814c4bb5a36ba9e80ef875f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e471342cb24c918197b538b2c8642a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:21.356148 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-a0b499bc-8397-4924-ac09-ce7817f23f57 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] 10.222.0.57 "GET /compute/v2.1/servers/7a3d7164-abc0-4d4a-89f5-dfd30c29baf8" status: 200 len: 1313 microversion: 2.1 time: 0.161762 Jun 07 09:31:21.356975 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 218/437] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:31:21 2022] GET /compute/v2.1/servers/7a3d7164-abc0-4d4a-89f5-dfd30c29baf8 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:31:21.610900 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-6ddd5267-2fc2-4776-9417-2c109c98c8ea tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:31:21.611503 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-6ddd5267-2fc2-4776-9417-2c109c98c8ea tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:31:21.617383 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-6ddd5267-2fc2-4776-9417-2c109c98c8ea tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:21.617832 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-6ddd5267-2fc2-4776-9417-2c109c98c8ea tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:21.618581 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-6ddd5267-2fc2-4776-9417-2c109c98c8ea tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:21.619016 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-6ddd5267-2fc2-4776-9417-2c109c98c8ea tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:21.642046 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-6ddd5267-2fc2-4776-9417-2c109c98c8ea tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25/ips" status: 200 len: 145 microversion: 2.1 time: 0.035834 Jun 07 09:31:21.642619 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 220/438] 10.222.0.57 () {58 vars in 1247 bytes} [Tue Jun 7 09:31:21 2022] GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25/ips => generated 145 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 09:31:22.375090 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-a20d4454-e07f-4bd1-a8b6-abc27aac6372 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:31:22.375688 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-a20d4454-e07f-4bd1-a8b6-abc27aac6372 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] [instance: 7a3d7164-abc0-4d4a-89f5-dfd30c29baf8] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:31:22.382580 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-a20d4454-e07f-4bd1-a8b6-abc27aac6372 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:22.383046 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-a20d4454-e07f-4bd1-a8b6-abc27aac6372 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:22.383796 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-a20d4454-e07f-4bd1-a8b6-abc27aac6372 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:22.384226 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-a20d4454-e07f-4bd1-a8b6-abc27aac6372 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:22.519412 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-a20d4454-e07f-4bd1-a8b6-abc27aac6372 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae6107c814c4bb5a36ba9e80ef875f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e471342cb24c918197b538b2c8642a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:22.530969 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-a20d4454-e07f-4bd1-a8b6-abc27aac6372 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] 10.222.0.57 "GET /compute/v2.1/servers/7a3d7164-abc0-4d4a-89f5-dfd30c29baf8" status: 200 len: 1313 microversion: 2.1 time: 0.160790 Jun 07 09:31:22.540858 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 219/439] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:31:22 2022] GET /compute/v2.1/servers/7a3d7164-abc0-4d4a-89f5-dfd30c29baf8 => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:31:23.323592 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [req-13d7fa2f-1f59-4ffb-ab58-89b44ba82890 req-c09055d3-2e94-4850-9061-7fccaee56de0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a3d7164-abc0-4d4a-89f5-dfd30c29baf8", "name": "network-vif-plugged", "status": "completed", "tag": "30ccf474-d769-4221-8975-1481ddd95c25"}]} {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:31:23.331776 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [req-13d7fa2f-1f59-4ffb-ab58-89b44ba82890 req-c09055d3-2e94-4850-9061-7fccaee56de0 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:23.332242 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [req-13d7fa2f-1f59-4ffb-ab58-89b44ba82890 req-c09055d3-2e94-4850-9061-7fccaee56de0 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:23.343315 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.compute.server_external_events [req-13d7fa2f-1f59-4ffb-ab58-89b44ba82890 req-c09055d3-2e94-4850-9061-7fccaee56de0 service nova] Creating event network-vif-plugged:30ccf474-d769-4221-8975-1481ddd95c25 for instance 7a3d7164-abc0-4d4a-89f5-dfd30c29baf8 on hv-cinder-83699 Jun 07 09:31:23.348494 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [req-13d7fa2f-1f59-4ffb-ab58-89b44ba82890 req-c09055d3-2e94-4850-9061-7fccaee56de0 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028902 Jun 07 09:31:23.349149 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 221/440] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Jun 7 09:31:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:31:23.548105 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-e8858361-323c-4ab9-8d38-ec9ea5dea649 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:31:23.548884 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-e8858361-323c-4ab9-8d38-ec9ea5dea649 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] [instance: 7a3d7164-abc0-4d4a-89f5-dfd30c29baf8] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:31:23.555633 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-e8858361-323c-4ab9-8d38-ec9ea5dea649 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:23.556358 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-e8858361-323c-4ab9-8d38-ec9ea5dea649 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:23.557192 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-e8858361-323c-4ab9-8d38-ec9ea5dea649 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:23.557692 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-e8858361-323c-4ab9-8d38-ec9ea5dea649 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:23.733902 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-e8858361-323c-4ab9-8d38-ec9ea5dea649 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae6107c814c4bb5a36ba9e80ef875f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e471342cb24c918197b538b2c8642a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:23.741782 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-e8858361-323c-4ab9-8d38-ec9ea5dea649 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] 10.222.0.57 "GET /compute/v2.1/servers/7a3d7164-abc0-4d4a-89f5-dfd30c29baf8" status: 200 len: 1313 microversion: 2.1 time: 0.198335 Jun 07 09:31:23.742466 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 220/441] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:31:23 2022] GET /compute/v2.1/servers/7a3d7164-abc0-4d4a-89f5-dfd30c29baf8 => generated 1313 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:31:24.759850 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-28b63e81-c2ff-4704-94b3-786349677d3f tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:31:24.760534 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-28b63e81-c2ff-4704-94b3-786349677d3f tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] [instance: 7a3d7164-abc0-4d4a-89f5-dfd30c29baf8] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:31:24.767249 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-28b63e81-c2ff-4704-94b3-786349677d3f tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:24.767688 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-28b63e81-c2ff-4704-94b3-786349677d3f tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:24.768429 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-28b63e81-c2ff-4704-94b3-786349677d3f tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:24.768889 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-28b63e81-c2ff-4704-94b3-786349677d3f tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:24.901302 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-28b63e81-c2ff-4704-94b3-786349677d3f tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae6107c814c4bb5a36ba9e80ef875f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e471342cb24c918197b538b2c8642a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:24.908610 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-28b63e81-c2ff-4704-94b3-786349677d3f tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] 10.222.0.57 "GET /compute/v2.1/servers/7a3d7164-abc0-4d4a-89f5-dfd30c29baf8" status: 200 len: 1313 microversion: 2.1 time: 0.152911 Jun 07 09:31:24.909243 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 222/442] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:31:24 2022] GET /compute/v2.1/servers/7a3d7164-abc0-4d4a-89f5-dfd30c29baf8 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:31:25.332409 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-f24decaa-69a6-45af-b022-1bb34613ee20 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1614fd19-6fec-47e8-95c4-e42fa3f07102"}} {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:31:25.333507 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-f24decaa-69a6-45af-b022-1bb34613ee20 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:31:25.339841 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-f24decaa-69a6-45af-b022-1bb34613ee20 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:25.340294 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-f24decaa-69a6-45af-b022-1bb34613ee20 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:25.341084 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-f24decaa-69a6-45af-b022-1bb34613ee20 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:25.341522 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-f24decaa-69a6-45af-b022-1bb34613ee20 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:25.925420 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-ba078f24-b2f4-4b38-995e-4b24041c5b04 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:31:25.926073 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-ba078f24-b2f4-4b38-995e-4b24041c5b04 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] [instance: 7a3d7164-abc0-4d4a-89f5-dfd30c29baf8] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:31:25.932128 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-ba078f24-b2f4-4b38-995e-4b24041c5b04 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:25.932606 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-ba078f24-b2f4-4b38-995e-4b24041c5b04 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:25.933371 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-ba078f24-b2f4-4b38-995e-4b24041c5b04 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:25.933814 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-ba078f24-b2f4-4b38-995e-4b24041c5b04 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:26.069654 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-ba078f24-b2f4-4b38-995e-4b24041c5b04 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae6107c814c4bb5a36ba9e80ef875f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e471342cb24c918197b538b2c8642a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:26.081363 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-ba078f24-b2f4-4b38-995e-4b24041c5b04 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] 10.222.0.57 "GET /compute/v2.1/servers/7a3d7164-abc0-4d4a-89f5-dfd30c29baf8" status: 200 len: 1313 microversion: 2.1 time: 0.156199 Jun 07 09:31:26.081363 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 223/443] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:31:25 2022] GET /compute/v2.1/servers/7a3d7164-abc0-4d4a-89f5-dfd30c29baf8 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:31:26.863232 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-f24decaa-69a6-45af-b022-1bb34613ee20 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "POST /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.534651 Jun 07 09:31:26.863844 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 221/444] 10.222.0.57 () {60 vars in 1322 bytes} [Tue Jun 7 09:31:25 2022] POST /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25/os-volume_attachments => generated 194 bytes in 1536 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:31:27.094676 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-5f8ff6ad-a186-4f2e-9564-5acaf537db3b tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:31:27.095287 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-5f8ff6ad-a186-4f2e-9564-5acaf537db3b tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] [instance: 7a3d7164-abc0-4d4a-89f5-dfd30c29baf8] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:31:27.101499 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-5f8ff6ad-a186-4f2e-9564-5acaf537db3b tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:27.101951 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-5f8ff6ad-a186-4f2e-9564-5acaf537db3b tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:27.102810 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-5f8ff6ad-a186-4f2e-9564-5acaf537db3b tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:27.103247 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-5f8ff6ad-a186-4f2e-9564-5acaf537db3b tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:27.231038 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-5f8ff6ad-a186-4f2e-9564-5acaf537db3b tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae6107c814c4bb5a36ba9e80ef875f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e471342cb24c918197b538b2c8642a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:27.239125 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-5f8ff6ad-a186-4f2e-9564-5acaf537db3b tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] 10.222.0.57 "GET /compute/v2.1/servers/7a3d7164-abc0-4d4a-89f5-dfd30c29baf8" status: 200 len: 1498 microversion: 2.1 time: 0.148576 Jun 07 09:31:27.239680 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 224/445] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:31:27 2022] GET /compute/v2.1/servers/7a3d7164-abc0-4d4a-89f5-dfd30c29baf8 => generated 1498 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:31:28.289721 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-8727c6ce-9290-4959-9dd8-723ce25a4e40 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:31:28.290301 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-8727c6ce-9290-4959-9dd8-723ce25a4e40 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] [instance: 7a3d7164-abc0-4d4a-89f5-dfd30c29baf8] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:31:28.297969 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-8727c6ce-9290-4959-9dd8-723ce25a4e40 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:28.298420 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-8727c6ce-9290-4959-9dd8-723ce25a4e40 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:28.299184 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-8727c6ce-9290-4959-9dd8-723ce25a4e40 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:28.299626 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-8727c6ce-9290-4959-9dd8-723ce25a4e40 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:28.324029 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-8727c6ce-9290-4959-9dd8-723ce25a4e40 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] [instance: 7a3d7164-abc0-4d4a-89f5-dfd30c29baf8] Going to try to terminate instance {{(pid=118740) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 09:31:28.719790 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-8727c6ce-9290-4959-9dd8-723ce25a4e40 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] 10.222.0.57 "DELETE /compute/v2.1/servers/7a3d7164-abc0-4d4a-89f5-dfd30c29baf8" status: 204 len: 0 microversion: 2.1 time: 0.433923 Jun 07 09:31:28.720402 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 222/446] 10.222.0.57 () {58 vars in 1238 bytes} [Tue Jun 7 09:31:28 2022] DELETE /compute/v2.1/servers/7a3d7164-abc0-4d4a-89f5-dfd30c29baf8 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 09:31:28.728770 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-5759eb5c-c15b-4ef0-beb9-ffc598fdc18b tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:31:28.729397 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-5759eb5c-c15b-4ef0-beb9-ffc598fdc18b tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] [instance: 7a3d7164-abc0-4d4a-89f5-dfd30c29baf8] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:31:28.735756 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-5759eb5c-c15b-4ef0-beb9-ffc598fdc18b tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:28.736207 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-5759eb5c-c15b-4ef0-beb9-ffc598fdc18b tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:28.737003 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-5759eb5c-c15b-4ef0-beb9-ffc598fdc18b tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:28.737442 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-5759eb5c-c15b-4ef0-beb9-ffc598fdc18b tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:28.865445 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-5759eb5c-c15b-4ef0-beb9-ffc598fdc18b tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae6107c814c4bb5a36ba9e80ef875f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e471342cb24c918197b538b2c8642a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:28.871646 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-5759eb5c-c15b-4ef0-beb9-ffc598fdc18b tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] 10.222.0.57 "GET /compute/v2.1/servers/7a3d7164-abc0-4d4a-89f5-dfd30c29baf8" status: 200 len: 1504 microversion: 2.1 time: 0.147015 Jun 07 09:31:28.872204 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 225/447] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:31:28 2022] GET /compute/v2.1/servers/7a3d7164-abc0-4d4a-89f5-dfd30c29baf8 => generated 1504 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:31:29.889647 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-7c5cd6eb-24e4-4481-b366-46c5ab45b4da tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:31:29.890353 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-7c5cd6eb-24e4-4481-b366-46c5ab45b4da tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] [instance: 7a3d7164-abc0-4d4a-89f5-dfd30c29baf8] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:31:29.896834 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-7c5cd6eb-24e4-4481-b366-46c5ab45b4da tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:29.897291 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-7c5cd6eb-24e4-4481-b366-46c5ab45b4da tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:29.898079 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-7c5cd6eb-24e4-4481-b366-46c5ab45b4da tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:29.898521 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-7c5cd6eb-24e4-4481-b366-46c5ab45b4da tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:30.025359 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-7c5cd6eb-24e4-4481-b366-46c5ab45b4da tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae6107c814c4bb5a36ba9e80ef875f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e471342cb24c918197b538b2c8642a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:30.032871 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-7c5cd6eb-24e4-4481-b366-46c5ab45b4da tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] 10.222.0.57 "GET /compute/v2.1/servers/7a3d7164-abc0-4d4a-89f5-dfd30c29baf8" status: 200 len: 1504 microversion: 2.1 time: 0.147510 Jun 07 09:31:30.035217 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 223/448] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:31:29 2022] GET /compute/v2.1/servers/7a3d7164-abc0-4d4a-89f5-dfd30c29baf8 => generated 1504 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:31:31.051654 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-99252dee-8121-4df3-bf02-61f5e776e6e2 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:31:31.052296 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-99252dee-8121-4df3-bf02-61f5e776e6e2 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] [instance: 7a3d7164-abc0-4d4a-89f5-dfd30c29baf8] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:31:31.058424 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-99252dee-8121-4df3-bf02-61f5e776e6e2 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:31.058871 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-99252dee-8121-4df3-bf02-61f5e776e6e2 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:31.059626 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-99252dee-8121-4df3-bf02-61f5e776e6e2 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:31.060069 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-99252dee-8121-4df3-bf02-61f5e776e6e2 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:31.064741 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writing DB stats nova_cell1:SELECT=100 {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:31:31.261823 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-99252dee-8121-4df3-bf02-61f5e776e6e2 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae6107c814c4bb5a36ba9e80ef875f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e471342cb24c918197b538b2c8642a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:31.265213 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-99252dee-8121-4df3-bf02-61f5e776e6e2 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] 10.222.0.57 "GET /compute/v2.1/servers/7a3d7164-abc0-4d4a-89f5-dfd30c29baf8" status: 200 len: 1504 microversion: 2.1 time: 0.217282 Jun 07 09:31:31.271487 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 226/449] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:31:31 2022] GET /compute/v2.1/servers/7a3d7164-abc0-4d4a-89f5-dfd30c29baf8 => generated 1504 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:31:31.271659 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [req-3e9720bf-7da4-43e1-b76a-7d840babf733 req-9e642fff-84cb-42b8-bdf2-480975e0f574 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a3d7164-abc0-4d4a-89f5-dfd30c29baf8", "name": "network-vif-deleted", "tag": "30ccf474-d769-4221-8975-1481ddd95c25"}]} {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:31:31.275106 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [req-3e9720bf-7da4-43e1-b76a-7d840babf733 req-9e642fff-84cb-42b8-bdf2-480975e0f574 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:31.275546 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [req-3e9720bf-7da4-43e1-b76a-7d840babf733 req-9e642fff-84cb-42b8-bdf2-480975e0f574 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:31.286609 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.compute.server_external_events [req-3e9720bf-7da4-43e1-b76a-7d840babf733 req-9e642fff-84cb-42b8-bdf2-480975e0f574 service nova] Creating event network-vif-deleted:30ccf474-d769-4221-8975-1481ddd95c25 for instance 7a3d7164-abc0-4d4a-89f5-dfd30c29baf8 on hv-cinder-83699 Jun 07 09:31:31.291271 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [req-3e9720bf-7da4-43e1-b76a-7d840babf733 req-9e642fff-84cb-42b8-bdf2-480975e0f574 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028176 Jun 07 09:31:31.295620 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 224/450] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Jun 7 09:31:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 09:31:32.284014 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-73695914-d041-4552-a080-e84ae332d11b tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:31:32.284683 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-73695914-d041-4552-a080-e84ae332d11b tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] [instance: 7a3d7164-abc0-4d4a-89f5-dfd30c29baf8] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:31:32.290673 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-73695914-d041-4552-a080-e84ae332d11b tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:32.291118 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-73695914-d041-4552-a080-e84ae332d11b tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:32.291872 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-73695914-d041-4552-a080-e84ae332d11b tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:32.292300 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-73695914-d041-4552-a080-e84ae332d11b tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:32.321942 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-73695914-d041-4552-a080-e84ae332d11b tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:32.322386 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-73695914-d041-4552-a080-e84ae332d11b tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:32.322827 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.objects.instance [None req-73695914-d041-4552-a080-e84ae332d11b tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lazy-loading 'fault' on Instance uuid 7a3d7164-abc0-4d4a-89f5-dfd30c29baf8 {{(pid=118741) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 09:31:32.363259 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-73695914-d041-4552-a080-e84ae332d11b tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae6107c814c4bb5a36ba9e80ef875f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e471342cb24c918197b538b2c8642a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:32.370538 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-73695914-d041-4552-a080-e84ae332d11b tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] 10.222.0.57 "GET /compute/v2.1/servers/7a3d7164-abc0-4d4a-89f5-dfd30c29baf8" status: 200 len: 1303 microversion: 2.1 time: 0.091734 Jun 07 09:31:32.373488 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 227/451] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:31:32 2022] GET /compute/v2.1/servers/7a3d7164-abc0-4d4a-89f5-dfd30c29baf8 => generated 1303 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:31:33.388812 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-756daba9-bc30-45ad-bf89-88df3c638ffc tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:31:33.389505 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-756daba9-bc30-45ad-bf89-88df3c638ffc tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] [instance: 7a3d7164-abc0-4d4a-89f5-dfd30c29baf8] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:31:33.395559 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-756daba9-bc30-45ad-bf89-88df3c638ffc tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:33.396003 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-756daba9-bc30-45ad-bf89-88df3c638ffc tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:33.396783 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-756daba9-bc30-45ad-bf89-88df3c638ffc tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:33.397215 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-756daba9-bc30-45ad-bf89-88df3c638ffc tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:33.410638 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.wsgi [None req-756daba9-bc30-45ad-bf89-88df3c638ffc tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] HTTP exception thrown: Instance 7a3d7164-abc0-4d4a-89f5-dfd30c29baf8 could not be found. Jun 07 09:31:33.412209 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-756daba9-bc30-45ad-bf89-88df3c638ffc tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Request method failure captured: Jun 07 09:31:33.412209 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: request: GET /compute/v2.1/servers/7a3d7164-abc0-4d4a-89f5-dfd30c29baf8 HTTP/1.1 Jun 07 09:31:33.412209 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Accept: application/json Jun 07 09:31:33.412209 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Accept-Encoding: identity Jun 07 09:31:33.412209 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Connection: close Jun 07 09:31:33.412209 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Content-Length: 0 Jun 07 09:31:33.412209 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Content-Type: application/json Jun 07 09:31:33.412209 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Host: 10.222.0.57 Jun 07 09:31:33.412209 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Openstack-System-Scope: None Jun 07 09:31:33.412209 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: User-Agent: python-urllib3/1.26.9 Jun 07 09:31:33.412209 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Auth-Token: gAAAAABinxraM1ffbm9WNJt6h9xgPWROQ5x_oWYtpTHICvTu9i1WZTT35yocBRvr1Rs01Uqq8huXpfL3IltQtHTVTB47X6KwnOqO5GP9BR1SeWc1B5Cg9HxBoQU9fbYlrakq_Oo9zg-yPx47J2afwcs9o-uDUYsshpiN2Qf6IGJ_WiK7B_FCpoc Jun 07 09:31:33.412209 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Domain-Id: None Jun 07 09:31:33.412209 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Domain-Name: None Jun 07 09:31:33.412209 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Identity-Status: Confirmed Jun 07 09:31:33.412209 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Is-Admin-Project: True Jun 07 09:31:33.412209 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Domain-Id: default Jun 07 09:31:33.412209 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Domain-Name: Default Jun 07 09:31:33.412209 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Id: 76e471342cb24c918197b538b2c8642a Jun 07 09:31:33.412209 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Name: tempest-VolumesActionsTest-1734739318 Jun 07 09:31:33.412209 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Role: reader,member Jun 07 09:31:33.412209 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Roles: reader,member Jun 07 09:31:33.413834 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/76e471342cb24c918197b538b2c8642a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/76e471342cb24c918197b538b2c8642a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_76e471342cb24c918197b538b2c8642a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/76e471342cb24c918197b538b2c8642a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 07 09:31:33.413834 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Tenant: tempest-VolumesActionsTest-1734739318 Jun 07 09:31:33.413834 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Tenant-Id: 76e471342cb24c918197b538b2c8642a Jun 07 09:31:33.413834 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Tenant-Name: tempest-VolumesActionsTest-1734739318 Jun 07 09:31:33.413834 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User: tempest-VolumesActionsTest-1734739318-project Jun 07 09:31:33.413834 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Domain-Id: default Jun 07 09:31:33.413834 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Domain-Name: Default Jun 07 09:31:33.413834 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Id: 7ae6107c814c4bb5a36ba9e80ef875f4 Jun 07 09:31:33.413834 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Name: tempest-VolumesActionsTest-1734739318-project Jun 07 09:31:33.413834 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: method: > Jun 07 09:31:33.413834 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: exception: Instance 7a3d7164-abc0-4d4a-89f5-dfd30c29baf8 could not be found. Jun 07 09:31:33.413834 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: action_args: {'id': '7a3d7164-abc0-4d4a-89f5-dfd30c29baf8'} Jun 07 09:31:33.414744 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 09:31:33.414744 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:31:33.414744 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 09:31:33.414744 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 09:31:33.414744 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 09:31:33.414744 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 09:31:33.414744 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 09:31:33.414744 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 09:31:33.414744 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 09:31:33.414744 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 09:31:33.414744 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a3d7164-abc0-4d4a-89f5-dfd30c29baf8 could not be found. Jun 07 09:31:33.414744 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:31:33.414744 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:31:33.414744 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:31:33.414744 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:31:33.414744 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:31:33.414744 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:31:33.414744 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 09:31:33.414744 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 09:31:33.414744 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 09:31:33.415948 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 09:31:33.415948 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 09:31:33.415948 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 09:31:33.415948 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 09:31:33.415948 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 09:31:33.415948 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 09:31:33.415948 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 09:31:33.415948 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a3d7164-abc0-4d4a-89f5-dfd30c29baf8 could not be found. Jun 07 09:31:33.415948 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:31:33.415948 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:31:33.415948 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:31:33.415948 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:31:33.415948 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:31:33.415948 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:31:33.415948 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 09:31:33.415948 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 09:31:33.415948 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a3d7164-abc0-4d4a-89f5-dfd30c29baf8 could not be found. Jun 07 09:31:33.415948 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:31:33.417058 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-756daba9-bc30-45ad-bf89-88df3c638ffc tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Returning 404 to user: Instance 7a3d7164-abc0-4d4a-89f5-dfd30c29baf8 could not be found. {{(pid=118740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 09:31:33.417058 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-756daba9-bc30-45ad-bf89-88df3c638ffc tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] 10.222.0.57 "GET /compute/v2.1/servers/7a3d7164-abc0-4d4a-89f5-dfd30c29baf8" status: 404 len: 111 microversion: 2.1 time: 0.029554 Jun 07 09:31:33.417058 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 225/452] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:31:33 2022] GET /compute/v2.1/servers/7a3d7164-abc0-4d4a-89f5-dfd30c29baf8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 09:31:33.509002 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-7ce2b4f9-0ce9-444b-9d95-672a07c30c69 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1637337088", "imageRef": "8fdb0275-8c58-4c9e-a2f3-3aae3a947526", "flavorRef": "452", "networks": [{"uuid": "0d188b8a-be5b-4676-82e6-d01c947766fd"}]}} {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:31:33.558118 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.network.neutron [None req-7ce2b4f9-0ce9-444b-9d95-672a07c30c69 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] validate_networks() for [('0d188b8a-be5b-4676-82e6-d01c947766fd', None, None, None, None, None)] {{(pid=118741) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 09:31:33.905243 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.virt.hardware [None req-7ce2b4f9-0ce9-444b-9d95-672a07c30c69 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Flavor limits 0:0:0 {{(pid=118741) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 09:31:33.905665 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.virt.hardware [None req-7ce2b4f9-0ce9-444b-9d95-672a07c30c69 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Image limits 0:0:0 {{(pid=118741) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 09:31:33.906186 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.virt.hardware [None req-7ce2b4f9-0ce9-444b-9d95-672a07c30c69 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Flavor pref 0:0:0 {{(pid=118741) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 09:31:33.906595 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.virt.hardware [None req-7ce2b4f9-0ce9-444b-9d95-672a07c30c69 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Image pref 0:0:0 {{(pid=118741) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 09:31:33.907006 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.virt.hardware [None req-7ce2b4f9-0ce9-444b-9d95-672a07c30c69 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118741) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 09:31:33.915684 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-7ce2b4f9-0ce9-444b-9d95-672a07c30c69 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:33.916131 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-7ce2b4f9-0ce9-444b-9d95-672a07c30c69 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:33.916987 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-7ce2b4f9-0ce9-444b-9d95-672a07c30c69 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:33.917425 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-7ce2b4f9-0ce9-444b-9d95-672a07c30c69 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:33.935123 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.quota [None req-7ce2b4f9-0ce9-444b-9d95-672a07c30c69 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Getting quotas for project 76e471342cb24c918197b538b2c8642a. Resources: {'instances', 'cores', 'ram'} {{(pid=118741) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 09:31:33.939672 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.quota [None req-7ce2b4f9-0ce9-444b-9d95-672a07c30c69 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Getting quotas for user 7ae6107c814c4bb5a36ba9e80ef875f4 and project 76e471342cb24c918197b538b2c8642a. Resources: {'instances', 'cores', 'ram'} {{(pid=118741) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 09:31:33.950526 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-7ce2b4f9-0ce9-444b-9d95-672a07c30c69 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Going to run 1 instances... {{(pid=118741) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 09:31:33.952811 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-7ce2b4f9-0ce9-444b-9d95-672a07c30c69 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] [instance: 0ff9a031-9aa3-45b7-8c07-193836e8acb9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8fdb0275-8c58-4c9e-a2f3-3aae3a947526',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118741) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 09:31:34.067500 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-7ce2b4f9-0ce9-444b-9d95-672a07c30c69 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.561812 Jun 07 09:31:34.068064 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 228/453] 10.222.0.57 () {60 vars in 1146 bytes} [Tue Jun 7 09:31:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 563 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 09:31:34.077979 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-09f12ec5-c1cb-477c-a445-72b1d088c65f tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:31:34.078598 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-09f12ec5-c1cb-477c-a445-72b1d088c65f tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] [instance: 0ff9a031-9aa3-45b7-8c07-193836e8acb9] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:31:34.135099 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-09f12ec5-c1cb-477c-a445-72b1d088c65f tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae6107c814c4bb5a36ba9e80ef875f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e471342cb24c918197b538b2c8642a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:34.143498 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-09f12ec5-c1cb-477c-a445-72b1d088c65f tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] 10.222.0.57 "GET /compute/v2.1/servers/0ff9a031-9aa3-45b7-8c07-193836e8acb9" status: 200 len: 1214 microversion: 2.1 time: 0.069262 Jun 07 09:31:34.144250 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 226/454] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:31:34 2022] GET /compute/v2.1/servers/0ff9a031-9aa3-45b7-8c07-193836e8acb9 => generated 1214 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:31:35.160746 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-4e624004-dc14-43ed-af8d-db471f0c5c19 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:31:35.161356 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-4e624004-dc14-43ed-af8d-db471f0c5c19 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] [instance: 0ff9a031-9aa3-45b7-8c07-193836e8acb9] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:31:35.167402 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-4e624004-dc14-43ed-af8d-db471f0c5c19 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:35.167846 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-4e624004-dc14-43ed-af8d-db471f0c5c19 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:35.168607 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-4e624004-dc14-43ed-af8d-db471f0c5c19 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:35.169092 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-4e624004-dc14-43ed-af8d-db471f0c5c19 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:35.229870 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-4e624004-dc14-43ed-af8d-db471f0c5c19 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae6107c814c4bb5a36ba9e80ef875f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e471342cb24c918197b538b2c8642a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:35.238095 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-4e624004-dc14-43ed-af8d-db471f0c5c19 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] 10.222.0.57 "GET /compute/v2.1/servers/0ff9a031-9aa3-45b7-8c07-193836e8acb9" status: 200 len: 1218 microversion: 2.1 time: 0.081273 Jun 07 09:31:35.238704 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 229/455] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:31:35 2022] GET /compute/v2.1/servers/0ff9a031-9aa3-45b7-8c07-193836e8acb9 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:31:35.445666 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-5bc9a0dc-f6eb-4a9d-8770-f1f0d6eb978c tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:31:35.455408 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-5bc9a0dc-f6eb-4a9d-8770-f1f0d6eb978c tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:35.455862 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-5bc9a0dc-f6eb-4a9d-8770-f1f0d6eb978c tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:35.514965 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-5bc9a0dc-f6eb-4a9d-8770-f1f0d6eb978c tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25] Going to try to stop instance {{(pid=118740) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 07 09:31:35.750878 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-5bc9a0dc-f6eb-4a9d-8770-f1f0d6eb978c tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "POST /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25/action" status: 202 len: 0 microversion: 2.1 time: 0.308846 Jun 07 09:31:35.751476 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 227/456] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Jun 7 09:31:35 2022] POST /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25/action => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 07 09:31:35.759497 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-52ceffb1-c180-438d-8a5b-898720b640fe tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:31:35.760109 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-52ceffb1-c180-438d-8a5b-898720b640fe tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:31:35.766754 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-52ceffb1-c180-438d-8a5b-898720b640fe tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:35.767146 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-52ceffb1-c180-438d-8a5b-898720b640fe tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:35.767895 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-52ceffb1-c180-438d-8a5b-898720b640fe tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:35.768328 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-52ceffb1-c180-438d-8a5b-898720b640fe tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:35.895167 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-52ceffb1-c180-438d-8a5b-898720b640fe tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0346f4e3855142059983083e71c2c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c21b1cbbd604d6d9c97ab7c3c788f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:35.903615 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-52ceffb1-c180-438d-8a5b-898720b640fe tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25" status: 200 len: 1722 microversion: 2.1 time: 0.147966 Jun 07 09:31:35.904178 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 230/457] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:31:35 2022] GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:31:36.255911 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-956e5481-2110-4c0e-a907-b2df74784259 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:31:36.256622 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-956e5481-2110-4c0e-a907-b2df74784259 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] [instance: 0ff9a031-9aa3-45b7-8c07-193836e8acb9] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:31:36.262767 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-956e5481-2110-4c0e-a907-b2df74784259 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:36.263211 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-956e5481-2110-4c0e-a907-b2df74784259 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:36.263964 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-956e5481-2110-4c0e-a907-b2df74784259 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:36.264392 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-956e5481-2110-4c0e-a907-b2df74784259 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:36.324271 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-956e5481-2110-4c0e-a907-b2df74784259 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae6107c814c4bb5a36ba9e80ef875f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e471342cb24c918197b538b2c8642a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:36.331848 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-956e5481-2110-4c0e-a907-b2df74784259 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] 10.222.0.57 "GET /compute/v2.1/servers/0ff9a031-9aa3-45b7-8c07-193836e8acb9" status: 200 len: 1266 microversion: 2.1 time: 0.080058 Jun 07 09:31:36.332389 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 228/458] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:31:36 2022] GET /compute/v2.1/servers/0ff9a031-9aa3-45b7-8c07-193836e8acb9 => generated 1266 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:31:36.920484 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-5c4eb744-34fb-4d5a-bf88-90f5355699ee tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:31:36.929631 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-5c4eb744-34fb-4d5a-bf88-90f5355699ee tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:31:36.929631 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-5c4eb744-34fb-4d5a-bf88-90f5355699ee tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:36.931252 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-5c4eb744-34fb-4d5a-bf88-90f5355699ee tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:36.932062 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-5c4eb744-34fb-4d5a-bf88-90f5355699ee tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:36.932498 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-5c4eb744-34fb-4d5a-bf88-90f5355699ee tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:37.148161 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-5c4eb744-34fb-4d5a-bf88-90f5355699ee tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0346f4e3855142059983083e71c2c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c21b1cbbd604d6d9c97ab7c3c788f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:37.157244 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-5c4eb744-34fb-4d5a-bf88-90f5355699ee tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25" status: 200 len: 1722 microversion: 2.1 time: 0.240564 Jun 07 09:31:37.157856 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 231/459] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:31:36 2022] GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 => generated 1722 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:31:37.349387 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-76c408c0-bcab-4ed5-b596-f633c2ccbaad tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:31:37.350092 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-76c408c0-bcab-4ed5-b596-f633c2ccbaad tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] [instance: 0ff9a031-9aa3-45b7-8c07-193836e8acb9] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:31:37.356422 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-76c408c0-bcab-4ed5-b596-f633c2ccbaad tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:37.356929 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-76c408c0-bcab-4ed5-b596-f633c2ccbaad tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:37.357930 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-76c408c0-bcab-4ed5-b596-f633c2ccbaad tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:37.358385 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-76c408c0-bcab-4ed5-b596-f633c2ccbaad tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:37.490299 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-76c408c0-bcab-4ed5-b596-f633c2ccbaad tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae6107c814c4bb5a36ba9e80ef875f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e471342cb24c918197b538b2c8642a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:37.497886 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-76c408c0-bcab-4ed5-b596-f633c2ccbaad tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] 10.222.0.57 "GET /compute/v2.1/servers/0ff9a031-9aa3-45b7-8c07-193836e8acb9" status: 200 len: 1314 microversion: 2.1 time: 0.152235 Jun 07 09:31:37.498448 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 229/460] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:31:37 2022] GET /compute/v2.1/servers/0ff9a031-9aa3-45b7-8c07-193836e8acb9 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:31:38.175116 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-37426182-4cf7-4517-9be6-5da2f1dd1cd7 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:31:38.175721 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-37426182-4cf7-4517-9be6-5da2f1dd1cd7 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:31:38.181866 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-37426182-4cf7-4517-9be6-5da2f1dd1cd7 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:38.182334 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-37426182-4cf7-4517-9be6-5da2f1dd1cd7 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:38.183096 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-37426182-4cf7-4517-9be6-5da2f1dd1cd7 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:38.183537 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-37426182-4cf7-4517-9be6-5da2f1dd1cd7 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:38.381852 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-37426182-4cf7-4517-9be6-5da2f1dd1cd7 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0346f4e3855142059983083e71c2c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c21b1cbbd604d6d9c97ab7c3c788f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:38.389999 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-37426182-4cf7-4517-9be6-5da2f1dd1cd7 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25" status: 200 len: 1722 microversion: 2.1 time: 0.219216 Jun 07 09:31:38.390562 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 232/461] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:31:38 2022] GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 => generated 1722 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:31:38.515175 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-77b2f64e-295e-4181-b2b5-10c304cae4ea tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:31:38.515784 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-77b2f64e-295e-4181-b2b5-10c304cae4ea tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] [instance: 0ff9a031-9aa3-45b7-8c07-193836e8acb9] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:31:38.522493 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-77b2f64e-295e-4181-b2b5-10c304cae4ea tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:38.522936 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-77b2f64e-295e-4181-b2b5-10c304cae4ea tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:38.523692 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-77b2f64e-295e-4181-b2b5-10c304cae4ea tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:38.524124 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-77b2f64e-295e-4181-b2b5-10c304cae4ea tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:38.549109 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [req-fba58800-1376-4ec4-83e9-837abb1083a0 req-7e8c8787-6cc7-42ca-b42d-1bf624795e13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ff9a031-9aa3-45b7-8c07-193836e8acb9", "tag": "41a54172-5933-4f7b-aa33-9853b5052f81"}]} {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:31:38.566921 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:31:38.576684 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [req-fba58800-1376-4ec4-83e9-837abb1083a0 req-7e8c8787-6cc7-42ca-b42d-1bf624795e13 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:38.577183 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [req-fba58800-1376-4ec4-83e9-837abb1083a0 req-7e8c8787-6cc7-42ca-b42d-1bf624795e13 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:38.588641 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.compute.server_external_events [req-fba58800-1376-4ec4-83e9-837abb1083a0 req-7e8c8787-6cc7-42ca-b42d-1bf624795e13 service nova] Creating event network-changed:41a54172-5933-4f7b-aa33-9853b5052f81 for instance 0ff9a031-9aa3-45b7-8c07-193836e8acb9 on hv-cinder-83699 Jun 07 09:31:38.594366 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [req-fba58800-1376-4ec4-83e9-837abb1083a0 req-7e8c8787-6cc7-42ca-b42d-1bf624795e13 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048865 Jun 07 09:31:38.595012 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 233/462] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Jun 7 09:31:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:31:38.659752 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-77b2f64e-295e-4181-b2b5-10c304cae4ea tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae6107c814c4bb5a36ba9e80ef875f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e471342cb24c918197b538b2c8642a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:38.667093 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-77b2f64e-295e-4181-b2b5-10c304cae4ea tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] 10.222.0.57 "GET /compute/v2.1/servers/0ff9a031-9aa3-45b7-8c07-193836e8acb9" status: 200 len: 1314 microversion: 2.1 time: 0.155801 Jun 07 09:31:38.667656 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 230/463] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:31:38 2022] GET /compute/v2.1/servers/0ff9a031-9aa3-45b7-8c07-193836e8acb9 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:31:39.369719 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-b4c60911-2433-448e-a38c-d396cf51f780 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:31:39.370315 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-b4c60911-2433-448e-a38c-d396cf51f780 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 0e41026b-9a96-47df-a158-d8ea485025bd] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:31:39.376956 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b4c60911-2433-448e-a38c-d396cf51f780 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:39.377401 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b4c60911-2433-448e-a38c-d396cf51f780 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:39.378154 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b4c60911-2433-448e-a38c-d396cf51f780 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:39.378615 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b4c60911-2433-448e-a38c-d396cf51f780 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:39.401794 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-b4c60911-2433-448e-a38c-d396cf51f780 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd/ips" status: 200 len: 149 microversion: 2.1 time: 0.036615 Jun 07 09:31:39.407630 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 234/464] 10.222.0.57 () {58 vars in 1247 bytes} [Tue Jun 7 09:31:39 2022] GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd/ips => generated 149 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:31:39.408079 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-b0649256-a24a-4d2f-9229-5cdd19e03411 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:31:39.408511 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-b0649256-a24a-4d2f-9229-5cdd19e03411 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:31:39.415193 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b0649256-a24a-4d2f-9229-5cdd19e03411 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:39.415757 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b0649256-a24a-4d2f-9229-5cdd19e03411 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:39.416631 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b0649256-a24a-4d2f-9229-5cdd19e03411 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:39.417143 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b0649256-a24a-4d2f-9229-5cdd19e03411 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:39.549228 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-b0649256-a24a-4d2f-9229-5cdd19e03411 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0346f4e3855142059983083e71c2c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c21b1cbbd604d6d9c97ab7c3c788f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:39.557475 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-b0649256-a24a-4d2f-9229-5cdd19e03411 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25" status: 200 len: 1722 microversion: 2.1 time: 0.154373 Jun 07 09:31:39.558074 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 231/465] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:31:39 2022] GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:31:39.683923 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-683a08e5-b2f5-4dca-b8be-de925bd11bfa tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:31:39.684538 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-683a08e5-b2f5-4dca-b8be-de925bd11bfa tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] [instance: 0ff9a031-9aa3-45b7-8c07-193836e8acb9] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:31:39.691353 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-683a08e5-b2f5-4dca-b8be-de925bd11bfa tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:39.691807 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-683a08e5-b2f5-4dca-b8be-de925bd11bfa tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:39.692566 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-683a08e5-b2f5-4dca-b8be-de925bd11bfa tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:39.693033 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-683a08e5-b2f5-4dca-b8be-de925bd11bfa tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:39.826822 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-683a08e5-b2f5-4dca-b8be-de925bd11bfa tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae6107c814c4bb5a36ba9e80ef875f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e471342cb24c918197b538b2c8642a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:39.835032 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-683a08e5-b2f5-4dca-b8be-de925bd11bfa tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] 10.222.0.57 "GET /compute/v2.1/servers/0ff9a031-9aa3-45b7-8c07-193836e8acb9" status: 200 len: 1314 microversion: 2.1 time: 0.154983 Jun 07 09:31:39.835603 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 235/466] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:31:39 2022] GET /compute/v2.1/servers/0ff9a031-9aa3-45b7-8c07-193836e8acb9 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:31:40.576442 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-887f7640-7e5c-4ddb-9c22-6932adb4a722 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:31:40.577026 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-887f7640-7e5c-4ddb-9c22-6932adb4a722 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:31:40.583507 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-887f7640-7e5c-4ddb-9c22-6932adb4a722 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:40.583954 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-887f7640-7e5c-4ddb-9c22-6932adb4a722 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:40.584739 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-887f7640-7e5c-4ddb-9c22-6932adb4a722 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:40.585185 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-887f7640-7e5c-4ddb-9c22-6932adb4a722 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:40.727912 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-887f7640-7e5c-4ddb-9c22-6932adb4a722 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0346f4e3855142059983083e71c2c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c21b1cbbd604d6d9c97ab7c3c788f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:40.736763 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-887f7640-7e5c-4ddb-9c22-6932adb4a722 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25" status: 200 len: 1722 microversion: 2.1 time: 0.164246 Jun 07 09:31:40.737321 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 232/467] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:31:40 2022] GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:31:40.853458 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-6e54671c-fbff-410f-a2ad-e638dc19ac75 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:31:40.854178 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-6e54671c-fbff-410f-a2ad-e638dc19ac75 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] [instance: 0ff9a031-9aa3-45b7-8c07-193836e8acb9] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:31:40.862496 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-6e54671c-fbff-410f-a2ad-e638dc19ac75 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:40.863069 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-6e54671c-fbff-410f-a2ad-e638dc19ac75 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:40.864076 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-6e54671c-fbff-410f-a2ad-e638dc19ac75 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:40.864639 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-6e54671c-fbff-410f-a2ad-e638dc19ac75 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:41.006118 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-6e54671c-fbff-410f-a2ad-e638dc19ac75 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae6107c814c4bb5a36ba9e80ef875f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e471342cb24c918197b538b2c8642a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:41.013730 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-6e54671c-fbff-410f-a2ad-e638dc19ac75 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] 10.222.0.57 "GET /compute/v2.1/servers/0ff9a031-9aa3-45b7-8c07-193836e8acb9" status: 200 len: 1314 microversion: 2.1 time: 0.165061 Jun 07 09:31:41.014322 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 236/468] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:31:40 2022] GET /compute/v2.1/servers/0ff9a031-9aa3-45b7-8c07-193836e8acb9 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:31:41.753405 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-18438d65-eb1b-49ea-b760-62998a567002 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:31:41.754039 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-18438d65-eb1b-49ea-b760-62998a567002 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:31:41.760529 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-18438d65-eb1b-49ea-b760-62998a567002 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:41.761024 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-18438d65-eb1b-49ea-b760-62998a567002 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:41.761776 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-18438d65-eb1b-49ea-b760-62998a567002 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:41.762207 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-18438d65-eb1b-49ea-b760-62998a567002 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:41.764876 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:31:41.893825 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-18438d65-eb1b-49ea-b760-62998a567002 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0346f4e3855142059983083e71c2c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c21b1cbbd604d6d9c97ab7c3c788f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:41.901852 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-18438d65-eb1b-49ea-b760-62998a567002 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25" status: 200 len: 1722 microversion: 2.1 time: 0.152622 Jun 07 09:31:41.902411 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 233/469] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:31:41 2022] GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:31:42.031698 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-4832d76c-ddfe-4ff2-ad98-a9454da3ff8c tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:31:42.032457 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-4832d76c-ddfe-4ff2-ad98-a9454da3ff8c tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] [instance: 0ff9a031-9aa3-45b7-8c07-193836e8acb9] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:31:42.038601 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-4832d76c-ddfe-4ff2-ad98-a9454da3ff8c tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:42.039079 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-4832d76c-ddfe-4ff2-ad98-a9454da3ff8c tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:42.039801 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-4832d76c-ddfe-4ff2-ad98-a9454da3ff8c tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:42.040232 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-4832d76c-ddfe-4ff2-ad98-a9454da3ff8c tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:42.065387 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-f240e484-a9ac-43a4-83b8-20376c59efce tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:31:42.065883 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-f240e484-a9ac-43a4-83b8-20376c59efce tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:31:42.071920 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-f240e484-a9ac-43a4-83b8-20376c59efce tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:42.072419 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-f240e484-a9ac-43a4-83b8-20376c59efce tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:42.073223 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-f240e484-a9ac-43a4-83b8-20376c59efce tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:42.073665 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-f240e484-a9ac-43a4-83b8-20376c59efce tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:42.098093 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-f240e484-a9ac-43a4-83b8-20376c59efce tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2/ips" status: 200 len: 150 microversion: 2.20 time: 0.036543 Jun 07 09:31:42.098792 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 234/470] 10.222.0.57 () {60 vars in 1288 bytes} [Tue Jun 7 09:31:42 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 07 09:31:42.168017 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-4832d76c-ddfe-4ff2-ad98-a9454da3ff8c tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae6107c814c4bb5a36ba9e80ef875f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e471342cb24c918197b538b2c8642a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:42.177957 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-4832d76c-ddfe-4ff2-ad98-a9454da3ff8c tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] 10.222.0.57 "GET /compute/v2.1/servers/0ff9a031-9aa3-45b7-8c07-193836e8acb9" status: 200 len: 1314 microversion: 2.1 time: 0.150537 Jun 07 09:31:42.178700 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 237/471] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:31:42 2022] GET /compute/v2.1/servers/0ff9a031-9aa3-45b7-8c07-193836e8acb9 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:31:42.215316 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-25bb82c4-d379-45d1-b50c-13e70c891dac tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d617ee6a-48c2-4f3a-8663-af9949cbeede"}} {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:31:42.216433 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-25bb82c4-d379-45d1-b50c-13e70c891dac tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 0e41026b-9a96-47df-a158-d8ea485025bd] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:31:42.223253 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-25bb82c4-d379-45d1-b50c-13e70c891dac tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:42.223876 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-25bb82c4-d379-45d1-b50c-13e70c891dac tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:42.224693 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-25bb82c4-d379-45d1-b50c-13e70c891dac tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:42.225128 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-25bb82c4-d379-45d1-b50c-13e70c891dac tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:42.920960 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-ed0d05c9-9a1f-446e-8a65-55e28da74751 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:31:42.921558 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-ed0d05c9-9a1f-446e-8a65-55e28da74751 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:31:42.928127 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-ed0d05c9-9a1f-446e-8a65-55e28da74751 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:42.928728 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-ed0d05c9-9a1f-446e-8a65-55e28da74751 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:42.929608 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-ed0d05c9-9a1f-446e-8a65-55e28da74751 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:42.930178 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-ed0d05c9-9a1f-446e-8a65-55e28da74751 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:43.072417 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-ed0d05c9-9a1f-446e-8a65-55e28da74751 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0346f4e3855142059983083e71c2c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c21b1cbbd604d6d9c97ab7c3c788f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:43.080869 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-ed0d05c9-9a1f-446e-8a65-55e28da74751 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25" status: 200 len: 1722 microversion: 2.1 time: 0.164997 Jun 07 09:31:43.081423 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 238/472] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:31:42 2022] GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:31:43.194999 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-6948f555-ec69-4a6c-bc09-d7344d92b044 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:31:43.195602 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-6948f555-ec69-4a6c-bc09-d7344d92b044 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] [instance: 0ff9a031-9aa3-45b7-8c07-193836e8acb9] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:31:43.201627 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-6948f555-ec69-4a6c-bc09-d7344d92b044 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:43.202069 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-6948f555-ec69-4a6c-bc09-d7344d92b044 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:43.202821 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-6948f555-ec69-4a6c-bc09-d7344d92b044 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:43.203252 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-6948f555-ec69-4a6c-bc09-d7344d92b044 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:43.206066 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-25bb82c4-d379-45d1-b50c-13e70c891dac tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "POST /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.994685 Jun 07 09:31:43.206681 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 235/473] 10.222.0.57 () {60 vars in 1322 bytes} [Tue Jun 7 09:31:42 2022] POST /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd/os-volume_attachments => generated 194 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:31:43.354406 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-6948f555-ec69-4a6c-bc09-d7344d92b044 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae6107c814c4bb5a36ba9e80ef875f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e471342cb24c918197b538b2c8642a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:43.363781 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-6948f555-ec69-4a6c-bc09-d7344d92b044 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] 10.222.0.57 "GET /compute/v2.1/servers/0ff9a031-9aa3-45b7-8c07-193836e8acb9" status: 200 len: 1314 microversion: 2.1 time: 0.172604 Jun 07 09:31:43.364381 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 239/474] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:31:43 2022] GET /compute/v2.1/servers/0ff9a031-9aa3-45b7-8c07-193836e8acb9 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:31:44.098437 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-27362d1d-f6f2-4d04-b3eb-f65515cf48ad tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:31:44.099220 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-27362d1d-f6f2-4d04-b3eb-f65515cf48ad tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:31:44.106086 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-27362d1d-f6f2-4d04-b3eb-f65515cf48ad tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:44.109798 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-27362d1d-f6f2-4d04-b3eb-f65515cf48ad tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:44.109798 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-27362d1d-f6f2-4d04-b3eb-f65515cf48ad tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:44.109798 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-27362d1d-f6f2-4d04-b3eb-f65515cf48ad tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:44.147877 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writing DB stats nova_cell0:SELECT=2 {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:31:44.252347 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-27362d1d-f6f2-4d04-b3eb-f65515cf48ad tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0346f4e3855142059983083e71c2c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c21b1cbbd604d6d9c97ab7c3c788f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:44.260775 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-27362d1d-f6f2-4d04-b3eb-f65515cf48ad tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25" status: 200 len: 1722 microversion: 2.1 time: 0.166495 Jun 07 09:31:44.261362 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 236/475] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:31:44 2022] GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:31:44.381276 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-daeddc9f-b157-4c53-ade4-29feb2e7c5ba tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:31:44.381899 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-daeddc9f-b157-4c53-ade4-29feb2e7c5ba tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] [instance: 0ff9a031-9aa3-45b7-8c07-193836e8acb9] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:31:44.383806 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writing DB stats nova_cell0:SELECT=2 {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:31:44.384466 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writing DB stats nova_cell0:SELECT=6 {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:31:44.389363 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-daeddc9f-b157-4c53-ade4-29feb2e7c5ba tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:44.390359 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-daeddc9f-b157-4c53-ade4-29feb2e7c5ba tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:44.391119 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-daeddc9f-b157-4c53-ade4-29feb2e7c5ba tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:44.391553 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-daeddc9f-b157-4c53-ade4-29feb2e7c5ba tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:44.520863 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-daeddc9f-b157-4c53-ade4-29feb2e7c5ba tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae6107c814c4bb5a36ba9e80ef875f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e471342cb24c918197b538b2c8642a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:44.528250 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-daeddc9f-b157-4c53-ade4-29feb2e7c5ba tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] 10.222.0.57 "GET /compute/v2.1/servers/0ff9a031-9aa3-45b7-8c07-193836e8acb9" status: 200 len: 1314 microversion: 2.1 time: 0.150813 Jun 07 09:31:44.528837 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 240/476] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:31:44 2022] GET /compute/v2.1/servers/0ff9a031-9aa3-45b7-8c07-193836e8acb9 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:31:45.278959 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-6c2f48bc-dde6-4901-aef2-1957bebb1953 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:31:45.279576 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-6c2f48bc-dde6-4901-aef2-1957bebb1953 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:31:45.281926 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:31:45.286838 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-6c2f48bc-dde6-4901-aef2-1957bebb1953 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:45.287375 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-6c2f48bc-dde6-4901-aef2-1957bebb1953 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:45.288092 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-6c2f48bc-dde6-4901-aef2-1957bebb1953 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:45.288533 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-6c2f48bc-dde6-4901-aef2-1957bebb1953 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:45.415477 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-9daeee03-fb1c-46f7-bae7-78eaf04e84d8 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:31:45.416133 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-9daeee03-fb1c-46f7-bae7-78eaf04e84d8 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:31:45.422274 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-9daeee03-fb1c-46f7-bae7-78eaf04e84d8 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:45.422722 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-9daeee03-fb1c-46f7-bae7-78eaf04e84d8 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:45.423480 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-9daeee03-fb1c-46f7-bae7-78eaf04e84d8 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:45.423916 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-9daeee03-fb1c-46f7-bae7-78eaf04e84d8 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:45.426652 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-6c2f48bc-dde6-4901-aef2-1957bebb1953 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0346f4e3855142059983083e71c2c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c21b1cbbd604d6d9c97ab7c3c788f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:45.434496 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-6c2f48bc-dde6-4901-aef2-1957bebb1953 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25" status: 200 len: 1722 microversion: 2.1 time: 0.159589 Jun 07 09:31:45.435056 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 237/477] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:31:45 2022] GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:31:45.446945 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.objects.instance [None req-9daeee03-fb1c-46f7-bae7-78eaf04e84d8 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lazy-loading 'flavor' on Instance uuid 102039c7-8224-43f7-9fb8-90b82968cfa2 {{(pid=118741) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 09:31:45.547726 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-fd75ca5e-044a-4e9c-ab03-8306aef2872f tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:31:45.548445 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-fd75ca5e-044a-4e9c-ab03-8306aef2872f tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] [instance: 0ff9a031-9aa3-45b7-8c07-193836e8acb9] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:31:45.556123 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-fd75ca5e-044a-4e9c-ab03-8306aef2872f tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:45.556712 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-fd75ca5e-044a-4e9c-ab03-8306aef2872f tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:45.557618 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-fd75ca5e-044a-4e9c-ab03-8306aef2872f tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:45.558444 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-fd75ca5e-044a-4e9c-ab03-8306aef2872f tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:45.699410 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-fd75ca5e-044a-4e9c-ab03-8306aef2872f tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae6107c814c4bb5a36ba9e80ef875f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e471342cb24c918197b538b2c8642a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:45.707124 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-fd75ca5e-044a-4e9c-ab03-8306aef2872f tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] 10.222.0.57 "GET /compute/v2.1/servers/0ff9a031-9aa3-45b7-8c07-193836e8acb9" status: 200 len: 1314 microversion: 2.1 time: 0.164722 Jun 07 09:31:45.707817 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 238/478] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:31:45 2022] GET /compute/v2.1/servers/0ff9a031-9aa3-45b7-8c07-193836e8acb9 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:31:45.761455 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [req-bf6294d1-62c6-425d-9e2e-d7cc460f26da req-1f28bed5-57e9-46bf-ba96-c56fc94ee75e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ff9a031-9aa3-45b7-8c07-193836e8acb9", "name": "network-vif-plugged", "status": "completed", "tag": "41a54172-5933-4f7b-aa33-9853b5052f81"}]} {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:31:45.770277 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [req-bf6294d1-62c6-425d-9e2e-d7cc460f26da req-1f28bed5-57e9-46bf-ba96-c56fc94ee75e service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:45.770724 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [req-bf6294d1-62c6-425d-9e2e-d7cc460f26da req-1f28bed5-57e9-46bf-ba96-c56fc94ee75e service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:45.781893 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.compute.server_external_events [req-bf6294d1-62c6-425d-9e2e-d7cc460f26da req-1f28bed5-57e9-46bf-ba96-c56fc94ee75e service nova] Creating event network-vif-plugged:41a54172-5933-4f7b-aa33-9853b5052f81 for instance 0ff9a031-9aa3-45b7-8c07-193836e8acb9 on hv-cinder-83699 Jun 07 09:31:45.786728 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [req-bf6294d1-62c6-425d-9e2e-d7cc460f26da req-1f28bed5-57e9-46bf-ba96-c56fc94ee75e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029062 Jun 07 09:31:45.787493 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 239/479] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Jun 7 09:31:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 09:31:46.002909 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-9daeee03-fb1c-46f7-bae7-78eaf04e84d8 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "POST /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2/action" status: 202 len: 0 microversion: 2.20 time: 0.592040 Jun 07 09:31:46.003775 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 241/480] 10.222.0.57 () {62 vars in 1318 bytes} [Tue Jun 7 09:31:45 2022] POST /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2/action => generated 0 bytes in 594 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 07 09:31:46.016617 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-4c933256-989a-4d4a-be0c-4586de71db6f tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:31:46.016617 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-4c933256-989a-4d4a-be0c-4586de71db6f tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:31:46.022204 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-4c933256-989a-4d4a-be0c-4586de71db6f tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:46.022659 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-4c933256-989a-4d4a-be0c-4586de71db6f tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:46.023441 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-4c933256-989a-4d4a-be0c-4586de71db6f tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:46.023883 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-4c933256-989a-4d4a-be0c-4586de71db6f tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:46.163786 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-4c933256-989a-4d4a-be0c-4586de71db6f tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:46.171791 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-4c933256-989a-4d4a-be0c-4586de71db6f tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:46.173431 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-4c933256-989a-4d4a-be0c-4586de71db6f tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:46.174650 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-4c933256-989a-4d4a-be0c-4586de71db6f tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1720 microversion: 2.20 time: 0.166538 Jun 07 09:31:46.175248 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 240/481] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:31:46 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1720 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:31:46.453538 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-b4335a19-87be-48f3-9d8f-557db5f75b49 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:31:46.454317 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-b4335a19-87be-48f3-9d8f-557db5f75b49 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:31:46.461104 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b4335a19-87be-48f3-9d8f-557db5f75b49 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:46.461561 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b4335a19-87be-48f3-9d8f-557db5f75b49 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:46.462368 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b4335a19-87be-48f3-9d8f-557db5f75b49 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:46.462842 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b4335a19-87be-48f3-9d8f-557db5f75b49 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:46.466956 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:31:46.593421 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-b4335a19-87be-48f3-9d8f-557db5f75b49 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0346f4e3855142059983083e71c2c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c21b1cbbd604d6d9c97ab7c3c788f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:46.601685 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-b4335a19-87be-48f3-9d8f-557db5f75b49 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25" status: 200 len: 1722 microversion: 2.1 time: 0.153205 Jun 07 09:31:46.602261 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 242/482] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:31:46 2022] GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:31:46.724162 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-b7bbbaff-e5a4-4c51-880f-b73e74f1b2db tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:31:46.724805 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-b7bbbaff-e5a4-4c51-880f-b73e74f1b2db tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] [instance: 0ff9a031-9aa3-45b7-8c07-193836e8acb9] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:31:46.731263 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b7bbbaff-e5a4-4c51-880f-b73e74f1b2db tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:46.731708 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b7bbbaff-e5a4-4c51-880f-b73e74f1b2db tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:46.732770 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b7bbbaff-e5a4-4c51-880f-b73e74f1b2db tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:46.733207 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b7bbbaff-e5a4-4c51-880f-b73e74f1b2db tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:46.864204 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-b7bbbaff-e5a4-4c51-880f-b73e74f1b2db tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae6107c814c4bb5a36ba9e80ef875f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e471342cb24c918197b538b2c8642a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:46.871515 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-b7bbbaff-e5a4-4c51-880f-b73e74f1b2db tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] 10.222.0.57 "GET /compute/v2.1/servers/0ff9a031-9aa3-45b7-8c07-193836e8acb9" status: 200 len: 1314 microversion: 2.1 time: 0.151184 Jun 07 09:31:46.872063 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 241/483] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:31:46 2022] GET /compute/v2.1/servers/0ff9a031-9aa3-45b7-8c07-193836e8acb9 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:31:47.193167 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-7476fe17-738c-43c4-b460-56bb4be3312b tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:31:47.193775 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-7476fe17-738c-43c4-b460-56bb4be3312b tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:31:47.199995 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-7476fe17-738c-43c4-b460-56bb4be3312b tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:47.200445 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-7476fe17-738c-43c4-b460-56bb4be3312b tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:47.201234 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-7476fe17-738c-43c4-b460-56bb4be3312b tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:47.201672 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-7476fe17-738c-43c4-b460-56bb4be3312b tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:47.329991 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-7476fe17-738c-43c4-b460-56bb4be3312b tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:47.338177 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-7476fe17-738c-43c4-b460-56bb4be3312b tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:47.339664 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-7476fe17-738c-43c4-b460-56bb4be3312b tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:47.340838 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-7476fe17-738c-43c4-b460-56bb4be3312b tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1720 microversion: 2.20 time: 0.151633 Jun 07 09:31:47.341415 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 243/484] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:31:47 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:31:47.619275 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-9911d9d3-9e5a-46bb-9e1a-79917d683a2c tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:31:47.619818 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-9911d9d3-9e5a-46bb-9e1a-79917d683a2c tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:31:47.626376 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-9911d9d3-9e5a-46bb-9e1a-79917d683a2c tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:47.626822 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-9911d9d3-9e5a-46bb-9e1a-79917d683a2c tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:47.627580 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-9911d9d3-9e5a-46bb-9e1a-79917d683a2c tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:47.628014 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-9911d9d3-9e5a-46bb-9e1a-79917d683a2c tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:47.752055 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-9911d9d3-9e5a-46bb-9e1a-79917d683a2c tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0346f4e3855142059983083e71c2c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c21b1cbbd604d6d9c97ab7c3c788f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:47.759915 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-9911d9d3-9e5a-46bb-9e1a-79917d683a2c tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25" status: 200 len: 1722 microversion: 2.1 time: 0.144529 Jun 07 09:31:47.760458 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 242/485] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:31:47 2022] GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 => generated 1722 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:31:47.888845 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-716cd59f-52ca-457f-b336-4492e9ac1f61 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:31:47.889390 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-716cd59f-52ca-457f-b336-4492e9ac1f61 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] [instance: 0ff9a031-9aa3-45b7-8c07-193836e8acb9] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:31:47.896471 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-716cd59f-52ca-457f-b336-4492e9ac1f61 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:47.896948 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-716cd59f-52ca-457f-b336-4492e9ac1f61 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:47.897696 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-716cd59f-52ca-457f-b336-4492e9ac1f61 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:47.898126 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-716cd59f-52ca-457f-b336-4492e9ac1f61 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:48.022965 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-716cd59f-52ca-457f-b336-4492e9ac1f61 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae6107c814c4bb5a36ba9e80ef875f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e471342cb24c918197b538b2c8642a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:48.031099 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-716cd59f-52ca-457f-b336-4492e9ac1f61 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] 10.222.0.57 "GET /compute/v2.1/servers/0ff9a031-9aa3-45b7-8c07-193836e8acb9" status: 200 len: 1314 microversion: 2.1 time: 0.145669 Jun 07 09:31:48.031679 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 244/486] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:31:47 2022] GET /compute/v2.1/servers/0ff9a031-9aa3-45b7-8c07-193836e8acb9 => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:31:48.359568 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-ebf7493e-200c-4ae0-b3de-138f9722ba39 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:31:48.360202 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-ebf7493e-200c-4ae0-b3de-138f9722ba39 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:31:48.366214 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-ebf7493e-200c-4ae0-b3de-138f9722ba39 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:48.366688 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-ebf7493e-200c-4ae0-b3de-138f9722ba39 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:48.367499 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-ebf7493e-200c-4ae0-b3de-138f9722ba39 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:48.367965 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-ebf7493e-200c-4ae0-b3de-138f9722ba39 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:48.498350 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-ebf7493e-200c-4ae0-b3de-138f9722ba39 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:48.507296 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-ebf7493e-200c-4ae0-b3de-138f9722ba39 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:48.509047 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-ebf7493e-200c-4ae0-b3de-138f9722ba39 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:48.510286 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-ebf7493e-200c-4ae0-b3de-138f9722ba39 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1720 microversion: 2.20 time: 0.154947 Jun 07 09:31:48.510862 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 243/487] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:31:48 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:31:48.776655 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-8b2fe100-2c4d-460f-aa45-e96b27ee5284 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:31:48.777329 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-8b2fe100-2c4d-460f-aa45-e96b27ee5284 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:31:48.783263 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-8b2fe100-2c4d-460f-aa45-e96b27ee5284 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:48.783715 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-8b2fe100-2c4d-460f-aa45-e96b27ee5284 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:48.784475 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-8b2fe100-2c4d-460f-aa45-e96b27ee5284 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:48.784941 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-8b2fe100-2c4d-460f-aa45-e96b27ee5284 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:48.917426 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-8b2fe100-2c4d-460f-aa45-e96b27ee5284 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0346f4e3855142059983083e71c2c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c21b1cbbd604d6d9c97ab7c3c788f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:48.926255 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-8b2fe100-2c4d-460f-aa45-e96b27ee5284 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25" status: 200 len: 1722 microversion: 2.1 time: 0.153417 Jun 07 09:31:48.926823 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 245/488] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:31:48 2022] GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:31:49.049151 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-a969f727-0c80-4315-9134-96ade77662f0 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:31:49.049809 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-a969f727-0c80-4315-9134-96ade77662f0 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] [instance: 0ff9a031-9aa3-45b7-8c07-193836e8acb9] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:31:49.057568 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-a969f727-0c80-4315-9134-96ade77662f0 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:49.058137 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-a969f727-0c80-4315-9134-96ade77662f0 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:49.059016 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-a969f727-0c80-4315-9134-96ade77662f0 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:49.059552 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-a969f727-0c80-4315-9134-96ade77662f0 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:49.197522 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-a969f727-0c80-4315-9134-96ade77662f0 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae6107c814c4bb5a36ba9e80ef875f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e471342cb24c918197b538b2c8642a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:49.208265 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-a969f727-0c80-4315-9134-96ade77662f0 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] 10.222.0.57 "GET /compute/v2.1/servers/0ff9a031-9aa3-45b7-8c07-193836e8acb9" status: 200 len: 1314 microversion: 2.1 time: 0.164576 Jun 07 09:31:49.208911 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 244/489] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:31:49 2022] GET /compute/v2.1/servers/0ff9a031-9aa3-45b7-8c07-193836e8acb9 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:31:49.529899 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-23e99f1c-09b8-497e-b363-3fcfadbbcd00 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:31:49.531170 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-23e99f1c-09b8-497e-b363-3fcfadbbcd00 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:31:49.537290 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-23e99f1c-09b8-497e-b363-3fcfadbbcd00 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:49.537735 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-23e99f1c-09b8-497e-b363-3fcfadbbcd00 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:49.538485 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-23e99f1c-09b8-497e-b363-3fcfadbbcd00 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:49.538919 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-23e99f1c-09b8-497e-b363-3fcfadbbcd00 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:49.676647 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-23e99f1c-09b8-497e-b363-3fcfadbbcd00 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:49.684555 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-23e99f1c-09b8-497e-b363-3fcfadbbcd00 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:49.686088 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-23e99f1c-09b8-497e-b363-3fcfadbbcd00 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:49.687223 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-23e99f1c-09b8-497e-b363-3fcfadbbcd00 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1720 microversion: 2.20 time: 0.161202 Jun 07 09:31:49.687767 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 246/490] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:31:49 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1720 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:31:49.945047 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-1f1111bd-6772-4693-9384-417b832b3416 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:31:49.945846 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-1f1111bd-6772-4693-9384-417b832b3416 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:31:49.954341 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-1f1111bd-6772-4693-9384-417b832b3416 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:49.954934 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-1f1111bd-6772-4693-9384-417b832b3416 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:49.955972 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-1f1111bd-6772-4693-9384-417b832b3416 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:49.956433 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-1f1111bd-6772-4693-9384-417b832b3416 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:50.100738 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-1f1111bd-6772-4693-9384-417b832b3416 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0346f4e3855142059983083e71c2c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c21b1cbbd604d6d9c97ab7c3c788f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:50.109433 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-1f1111bd-6772-4693-9384-417b832b3416 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25" status: 200 len: 1722 microversion: 2.1 time: 0.168930 Jun 07 09:31:50.109988 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 245/491] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:31:49 2022] GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:31:50.225333 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-a3632b23-2d4c-4dd7-a42a-95f9e218df7a tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:31:50.226570 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-a3632b23-2d4c-4dd7-a42a-95f9e218df7a tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] [instance: 0ff9a031-9aa3-45b7-8c07-193836e8acb9] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:31:50.233032 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-a3632b23-2d4c-4dd7-a42a-95f9e218df7a tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:50.233526 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-a3632b23-2d4c-4dd7-a42a-95f9e218df7a tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:50.234901 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-a3632b23-2d4c-4dd7-a42a-95f9e218df7a tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:50.235355 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-a3632b23-2d4c-4dd7-a42a-95f9e218df7a tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:50.367090 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-a3632b23-2d4c-4dd7-a42a-95f9e218df7a tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae6107c814c4bb5a36ba9e80ef875f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e471342cb24c918197b538b2c8642a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:50.375665 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-a3632b23-2d4c-4dd7-a42a-95f9e218df7a tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] 10.222.0.57 "GET /compute/v2.1/servers/0ff9a031-9aa3-45b7-8c07-193836e8acb9" status: 200 len: 1498 microversion: 2.1 time: 0.154288 Jun 07 09:31:50.376255 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 247/492] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:31:50 2022] GET /compute/v2.1/servers/0ff9a031-9aa3-45b7-8c07-193836e8acb9 => generated 1498 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:31:50.705925 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-b42e8ee7-3cf2-4e95-a860-0b2e91de7a68 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:31:50.706535 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-b42e8ee7-3cf2-4e95-a860-0b2e91de7a68 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:31:50.712673 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b42e8ee7-3cf2-4e95-a860-0b2e91de7a68 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:50.715115 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b42e8ee7-3cf2-4e95-a860-0b2e91de7a68 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:50.715115 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b42e8ee7-3cf2-4e95-a860-0b2e91de7a68 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:50.715115 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b42e8ee7-3cf2-4e95-a860-0b2e91de7a68 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:50.864458 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-b42e8ee7-3cf2-4e95-a860-0b2e91de7a68 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:50.872471 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-b42e8ee7-3cf2-4e95-a860-0b2e91de7a68 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:50.874054 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-b42e8ee7-3cf2-4e95-a860-0b2e91de7a68 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:50.875861 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-b42e8ee7-3cf2-4e95-a860-0b2e91de7a68 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1720 microversion: 2.20 time: 0.174461 Jun 07 09:31:50.876462 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 246/493] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:31:50 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1720 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:31:51.125602 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-d175b39b-2a42-463f-b4e2-ca0ee681aea0 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:31:51.126134 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-d175b39b-2a42-463f-b4e2-ca0ee681aea0 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:31:51.132121 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-d175b39b-2a42-463f-b4e2-ca0ee681aea0 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:51.132564 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-d175b39b-2a42-463f-b4e2-ca0ee681aea0 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:51.133360 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-d175b39b-2a42-463f-b4e2-ca0ee681aea0 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:51.133792 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-d175b39b-2a42-463f-b4e2-ca0ee681aea0 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:51.194116 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 09:31:51.194673 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Tue Jun 7 09:31:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 09:31:51.261674 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-d175b39b-2a42-463f-b4e2-ca0ee681aea0 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0346f4e3855142059983083e71c2c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c21b1cbbd604d6d9c97ab7c3c788f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:51.270199 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-d175b39b-2a42-463f-b4e2-ca0ee681aea0 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25" status: 200 len: 1722 microversion: 2.1 time: 0.148623 Jun 07 09:31:51.270797 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 248/494] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:31:51 2022] GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:31:51.391814 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-a4a9b2ff-93d1-4537-92ad-2ac18c07550c tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:31:51.392302 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-a4a9b2ff-93d1-4537-92ad-2ac18c07550c tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] [instance: 0ff9a031-9aa3-45b7-8c07-193836e8acb9] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:31:51.398667 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-a4a9b2ff-93d1-4537-92ad-2ac18c07550c tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:51.399110 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-a4a9b2ff-93d1-4537-92ad-2ac18c07550c tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:51.399869 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-a4a9b2ff-93d1-4537-92ad-2ac18c07550c tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:51.400295 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-a4a9b2ff-93d1-4537-92ad-2ac18c07550c tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:51.424406 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-a4a9b2ff-93d1-4537-92ad-2ac18c07550c tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] [instance: 0ff9a031-9aa3-45b7-8c07-193836e8acb9] Going to try to terminate instance {{(pid=118740) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 09:31:51.548154 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:31:51.781565 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-a4a9b2ff-93d1-4537-92ad-2ac18c07550c tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] 10.222.0.57 "DELETE /compute/v2.1/servers/0ff9a031-9aa3-45b7-8c07-193836e8acb9" status: 204 len: 0 microversion: 2.1 time: 0.393713 Jun 07 09:31:51.782293 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 247/495] 10.222.0.57 () {58 vars in 1238 bytes} [Tue Jun 7 09:31:51 2022] DELETE /compute/v2.1/servers/0ff9a031-9aa3-45b7-8c07-193836e8acb9 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 09:31:51.791938 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-81df812c-1f99-454b-b40f-77d4ddbb41fc tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:31:51.792671 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-81df812c-1f99-454b-b40f-77d4ddbb41fc tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] [instance: 0ff9a031-9aa3-45b7-8c07-193836e8acb9] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:31:51.800298 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-81df812c-1f99-454b-b40f-77d4ddbb41fc tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:51.800783 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-81df812c-1f99-454b-b40f-77d4ddbb41fc tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:51.801538 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-81df812c-1f99-454b-b40f-77d4ddbb41fc tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:51.801974 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-81df812c-1f99-454b-b40f-77d4ddbb41fc tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:51.897538 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-3ff96ed9-f5a6-429d-8484-58bb646c8a30 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:31:51.898368 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-3ff96ed9-f5a6-429d-8484-58bb646c8a30 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:31:51.907094 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-3ff96ed9-f5a6-429d-8484-58bb646c8a30 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:51.910688 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-3ff96ed9-f5a6-429d-8484-58bb646c8a30 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:51.910688 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-3ff96ed9-f5a6-429d-8484-58bb646c8a30 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:51.910688 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-3ff96ed9-f5a6-429d-8484-58bb646c8a30 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:51.933635 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-81df812c-1f99-454b-b40f-77d4ddbb41fc tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae6107c814c4bb5a36ba9e80ef875f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e471342cb24c918197b538b2c8642a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:51.941449 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-81df812c-1f99-454b-b40f-77d4ddbb41fc tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] 10.222.0.57 "GET /compute/v2.1/servers/0ff9a031-9aa3-45b7-8c07-193836e8acb9" status: 200 len: 1504 microversion: 2.1 time: 0.154190 Jun 07 09:31:51.942014 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 249/496] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:31:51 2022] GET /compute/v2.1/servers/0ff9a031-9aa3-45b7-8c07-193836e8acb9 => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:31:52.047081 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-3ff96ed9-f5a6-429d-8484-58bb646c8a30 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:52.055022 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-3ff96ed9-f5a6-429d-8484-58bb646c8a30 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:52.056474 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-3ff96ed9-f5a6-429d-8484-58bb646c8a30 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:52.057659 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-3ff96ed9-f5a6-429d-8484-58bb646c8a30 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1720 microversion: 2.20 time: 0.165263 Jun 07 09:31:52.058207 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 248/497] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:31:51 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1720 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 09:31:52.287320 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-7c5b7317-bdcd-4c0a-91e1-b84d166a4065 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:31:52.287962 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-7c5b7317-bdcd-4c0a-91e1-b84d166a4065 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:31:52.293968 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-7c5b7317-bdcd-4c0a-91e1-b84d166a4065 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:52.294415 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-7c5b7317-bdcd-4c0a-91e1-b84d166a4065 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:52.295180 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-7c5b7317-bdcd-4c0a-91e1-b84d166a4065 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:52.295678 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-7c5b7317-bdcd-4c0a-91e1-b84d166a4065 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:52.422651 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-7c5b7317-bdcd-4c0a-91e1-b84d166a4065 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0346f4e3855142059983083e71c2c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c21b1cbbd604d6d9c97ab7c3c788f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:52.430689 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-7c5b7317-bdcd-4c0a-91e1-b84d166a4065 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25" status: 200 len: 1699 microversion: 2.1 time: 0.147360 Jun 07 09:31:52.431256 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 250/498] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:31:52 2022] GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 => generated 1699 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:31:52.447365 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-daed70a0-5657-41ef-a258-16545b4a1ce5 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:31:52.454508 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-daed70a0-5657-41ef-a258-16545b4a1ce5 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:52.454954 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-daed70a0-5657-41ef-a258-16545b4a1ce5 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:52.476249 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-daed70a0-5657-41ef-a258-16545b4a1ce5 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25] Going to try to start instance {{(pid=118740) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 07 09:31:52.659077 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-daed70a0-5657-41ef-a258-16545b4a1ce5 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "POST /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25/action" status: 202 len: 0 microversion: 2.1 time: 0.215159 Jun 07 09:31:52.659555 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 249/499] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Jun 7 09:31:52 2022] POST /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25/action => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 09:31:52.668494 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-e567b8dd-bfd5-42c9-95ce-7e3e6c532af9 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:31:52.669251 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-e567b8dd-bfd5-42c9-95ce-7e3e6c532af9 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:31:52.676786 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-e567b8dd-bfd5-42c9-95ce-7e3e6c532af9 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:52.677249 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-e567b8dd-bfd5-42c9-95ce-7e3e6c532af9 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:52.678011 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-e567b8dd-bfd5-42c9-95ce-7e3e6c532af9 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:52.678450 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-e567b8dd-bfd5-42c9-95ce-7e3e6c532af9 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:52.806572 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-e567b8dd-bfd5-42c9-95ce-7e3e6c532af9 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0346f4e3855142059983083e71c2c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c21b1cbbd604d6d9c97ab7c3c788f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:52.814560 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-e567b8dd-bfd5-42c9-95ce-7e3e6c532af9 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25" status: 200 len: 1708 microversion: 2.1 time: 0.150642 Jun 07 09:31:52.815260 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 251/500] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:31:52 2022] GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 => generated 1708 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:31:52.832037 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-89a931b3-bb76-4b04-836e-dce67a53acf7 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Action: 'create', calling method: .version_select at 0x7f5c9208c550>, body: {"keypair": {"name": "tempest-keypair-318266299", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLUGo1D/PTP9E13297+SBHwOPwlH4nEcMc9JijVoMFOlVUUa0SrVt7HZqzUf87Oi9cL3+PjD3UACmcybytXfZOP5KItORO/c5+okzX9erD3cItFBbugmxseW8+sGMA7+nQ=="}} {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:31:52.846305 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.quota [None req-89a931b3-bb76-4b04-836e-dce67a53acf7 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Getting quotas for project 50189b9cf3b145ba84495af8db63c41b. Resources: {'key_pairs'} {{(pid=118740) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 09:31:52.850078 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.quota [None req-89a931b3-bb76-4b04-836e-dce67a53acf7 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Getting quotas for user 2f32356bb0bd4234ba817db581b62aad and project 50189b9cf3b145ba84495af8db63c41b. Resources: {'key_pairs'} {{(pid=118740) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 09:31:52.957559 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-89a931b3-bb76-4b04-836e-dce67a53acf7 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.130062 Jun 07 09:31:52.958202 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 250/501] 10.222.0.57 () {60 vars in 1158 bytes} [Tue Jun 7 09:31:52 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:31:52.959201 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-dc130e4b-c83c-41d7-8d8f-971955879033 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:31:52.959848 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-dc130e4b-c83c-41d7-8d8f-971955879033 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] [instance: 0ff9a031-9aa3-45b7-8c07-193836e8acb9] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:31:52.966737 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-dc130e4b-c83c-41d7-8d8f-971955879033 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:52.967344 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-dc130e4b-c83c-41d7-8d8f-971955879033 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:52.968214 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-dc130e4b-c83c-41d7-8d8f-971955879033 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:52.968764 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-dc130e4b-c83c-41d7-8d8f-971955879033 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:53.078242 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-97a7ab63-7703-4c55-a73c-4d801833ccd4 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:31:53.078980 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-97a7ab63-7703-4c55-a73c-4d801833ccd4 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:31:53.085287 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-97a7ab63-7703-4c55-a73c-4d801833ccd4 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:53.085738 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-97a7ab63-7703-4c55-a73c-4d801833ccd4 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:53.086506 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-97a7ab63-7703-4c55-a73c-4d801833ccd4 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:53.086942 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-97a7ab63-7703-4c55-a73c-4d801833ccd4 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:53.132779 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-dc130e4b-c83c-41d7-8d8f-971955879033 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae6107c814c4bb5a36ba9e80ef875f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e471342cb24c918197b538b2c8642a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:53.149617 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-dc130e4b-c83c-41d7-8d8f-971955879033 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] 10.222.0.57 "GET /compute/v2.1/servers/0ff9a031-9aa3-45b7-8c07-193836e8acb9" status: 200 len: 1504 microversion: 2.1 time: 0.194043 Jun 07 09:31:53.152351 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 252/502] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:31:52 2022] GET /compute/v2.1/servers/0ff9a031-9aa3-45b7-8c07-193836e8acb9 => generated 1504 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:31:53.225629 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-97a7ab63-7703-4c55-a73c-4d801833ccd4 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:53.234803 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-97a7ab63-7703-4c55-a73c-4d801833ccd4 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:53.236315 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-97a7ab63-7703-4c55-a73c-4d801833ccd4 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:53.237533 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-97a7ab63-7703-4c55-a73c-4d801833ccd4 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1720 microversion: 2.20 time: 0.163319 Jun 07 09:31:53.242015 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 251/503] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:31:53 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1720 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 09:31:53.832027 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-4bf4c46f-f54c-42e0-9e3a-9dd3ba1eb9ce tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:31:53.832656 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-4bf4c46f-f54c-42e0-9e3a-9dd3ba1eb9ce tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:31:53.840138 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-4bf4c46f-f54c-42e0-9e3a-9dd3ba1eb9ce tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:53.840636 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-4bf4c46f-f54c-42e0-9e3a-9dd3ba1eb9ce tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:53.841546 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-4bf4c46f-f54c-42e0-9e3a-9dd3ba1eb9ce tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:53.841856 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-4bf4c46f-f54c-42e0-9e3a-9dd3ba1eb9ce tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:54.098108 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-4bf4c46f-f54c-42e0-9e3a-9dd3ba1eb9ce tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0346f4e3855142059983083e71c2c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c21b1cbbd604d6d9c97ab7c3c788f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:54.106153 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-4bf4c46f-f54c-42e0-9e3a-9dd3ba1eb9ce tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25" status: 200 len: 1708 microversion: 2.1 time: 0.278654 Jun 07 09:31:54.108127 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 253/504] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:31:53 2022] GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 => generated 1708 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:31:54.170658 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-f099de68-fd4d-453f-8d22-f58b2cef0906 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:31:54.173020 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-f099de68-fd4d-453f-8d22-f58b2cef0906 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] [instance: 0ff9a031-9aa3-45b7-8c07-193836e8acb9] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:31:54.180885 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-f099de68-fd4d-453f-8d22-f58b2cef0906 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:54.181715 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-f099de68-fd4d-453f-8d22-f58b2cef0906 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:54.182837 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-f099de68-fd4d-453f-8d22-f58b2cef0906 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:54.183438 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-f099de68-fd4d-453f-8d22-f58b2cef0906 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:54.257627 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-4071222a-d1a1-418c-9b36-93d0d9efad68 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:31:54.258242 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-4071222a-d1a1-418c-9b36-93d0d9efad68 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:31:54.264741 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-4071222a-d1a1-418c-9b36-93d0d9efad68 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:54.265565 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-4071222a-d1a1-418c-9b36-93d0d9efad68 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:54.266355 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-4071222a-d1a1-418c-9b36-93d0d9efad68 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:54.266775 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-4071222a-d1a1-418c-9b36-93d0d9efad68 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:54.310143 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-f099de68-fd4d-453f-8d22-f58b2cef0906 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae6107c814c4bb5a36ba9e80ef875f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e471342cb24c918197b538b2c8642a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:54.318813 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-f099de68-fd4d-453f-8d22-f58b2cef0906 tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] 10.222.0.57 "GET /compute/v2.1/servers/0ff9a031-9aa3-45b7-8c07-193836e8acb9" status: 200 len: 1462 microversion: 2.1 time: 0.153102 Jun 07 09:31:54.319472 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 252/505] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:31:54 2022] GET /compute/v2.1/servers/0ff9a031-9aa3-45b7-8c07-193836e8acb9 => generated 1462 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:31:54.324230 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [req-0d164ef2-fbff-49d9-bfdf-d384de8f2bcb req-146c957f-ac52-48ea-b86d-d5c836d23c79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ff9a031-9aa3-45b7-8c07-193836e8acb9", "name": "network-vif-deleted", "tag": "41a54172-5933-4f7b-aa33-9853b5052f81"}]} {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:31:54.341156 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [req-0d164ef2-fbff-49d9-bfdf-d384de8f2bcb req-146c957f-ac52-48ea-b86d-d5c836d23c79 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:54.341156 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [req-0d164ef2-fbff-49d9-bfdf-d384de8f2bcb req-146c957f-ac52-48ea-b86d-d5c836d23c79 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:54.354193 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.compute.server_external_events [req-0d164ef2-fbff-49d9-bfdf-d384de8f2bcb req-146c957f-ac52-48ea-b86d-d5c836d23c79 service nova] Creating event network-vif-deleted:41a54172-5933-4f7b-aa33-9853b5052f81 for instance 0ff9a031-9aa3-45b7-8c07-193836e8acb9 on hv-cinder-83699 Jun 07 09:31:54.359652 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [req-0d164ef2-fbff-49d9-bfdf-d384de8f2bcb req-146c957f-ac52-48ea-b86d-d5c836d23c79 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038749 Jun 07 09:31:54.360512 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 253/506] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Jun 7 09:31:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:31:54.440142 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-4071222a-d1a1-418c-9b36-93d0d9efad68 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:54.448164 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-4071222a-d1a1-418c-9b36-93d0d9efad68 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:54.449739 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-4071222a-d1a1-418c-9b36-93d0d9efad68 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:54.450888 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-4071222a-d1a1-418c-9b36-93d0d9efad68 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1720 microversion: 2.20 time: 0.198500 Jun 07 09:31:54.451440 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 254/507] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:31:54 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1720 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:31:55.124332 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-cdc36811-c31d-4495-8713-c40ad15f7517 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:31:55.125145 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-cdc36811-c31d-4495-8713-c40ad15f7517 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:31:55.131315 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-cdc36811-c31d-4495-8713-c40ad15f7517 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:55.131830 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-cdc36811-c31d-4495-8713-c40ad15f7517 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:55.132524 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-cdc36811-c31d-4495-8713-c40ad15f7517 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:55.133013 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-cdc36811-c31d-4495-8713-c40ad15f7517 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:55.313701 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-cdc36811-c31d-4495-8713-c40ad15f7517 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0346f4e3855142059983083e71c2c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c21b1cbbd604d6d9c97ab7c3c788f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:55.321906 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-cdc36811-c31d-4495-8713-c40ad15f7517 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25" status: 200 len: 1708 microversion: 2.1 time: 0.202446 Jun 07 09:31:55.322475 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 254/508] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:31:55 2022] GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 => generated 1708 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:31:55.335666 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-58e529e8-5a7f-4dd3-a9da-74759d77ce0d tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:31:55.336281 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-58e529e8-5a7f-4dd3-a9da-74759d77ce0d tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] [instance: 0ff9a031-9aa3-45b7-8c07-193836e8acb9] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:31:55.344034 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-58e529e8-5a7f-4dd3-a9da-74759d77ce0d tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:55.344505 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-58e529e8-5a7f-4dd3-a9da-74759d77ce0d tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:55.345310 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-58e529e8-5a7f-4dd3-a9da-74759d77ce0d tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:55.345752 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-58e529e8-5a7f-4dd3-a9da-74759d77ce0d tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:55.378167 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-58e529e8-5a7f-4dd3-a9da-74759d77ce0d tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:55.378617 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-58e529e8-5a7f-4dd3-a9da-74759d77ce0d tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:55.382622 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.objects.instance [None req-58e529e8-5a7f-4dd3-a9da-74759d77ce0d tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lazy-loading 'fault' on Instance uuid 0ff9a031-9aa3-45b7-8c07-193836e8acb9 {{(pid=118741) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 09:31:55.422096 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-58e529e8-5a7f-4dd3-a9da-74759d77ce0d tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae6107c814c4bb5a36ba9e80ef875f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e471342cb24c918197b538b2c8642a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:55.430250 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-58e529e8-5a7f-4dd3-a9da-74759d77ce0d tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] 10.222.0.57 "GET /compute/v2.1/servers/0ff9a031-9aa3-45b7-8c07-193836e8acb9" status: 200 len: 1304 microversion: 2.1 time: 0.098348 Jun 07 09:31:55.430864 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 255/509] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:31:55 2022] GET /compute/v2.1/servers/0ff9a031-9aa3-45b7-8c07-193836e8acb9 => generated 1304 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:31:55.469756 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-7905330d-bcc6-4ab8-8d79-d8c52a59ec34 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:31:55.470360 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-7905330d-bcc6-4ab8-8d79-d8c52a59ec34 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:31:55.476345 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-7905330d-bcc6-4ab8-8d79-d8c52a59ec34 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:55.476828 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-7905330d-bcc6-4ab8-8d79-d8c52a59ec34 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:55.477621 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-7905330d-bcc6-4ab8-8d79-d8c52a59ec34 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:55.478058 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-7905330d-bcc6-4ab8-8d79-d8c52a59ec34 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:55.606561 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-7905330d-bcc6-4ab8-8d79-d8c52a59ec34 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:55.615262 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-7905330d-bcc6-4ab8-8d79-d8c52a59ec34 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:55.616800 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-7905330d-bcc6-4ab8-8d79-d8c52a59ec34 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:55.623503 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-7905330d-bcc6-4ab8-8d79-d8c52a59ec34 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1720 microversion: 2.20 time: 0.152729 Jun 07 09:31:55.623503 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 255/510] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:31:55 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:31:55.898742 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-b4484788-bf1e-4505-8406-76d095593a8d tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-236453248", "imageRef": "8fdb0275-8c58-4c9e-a2f3-3aae3a947526", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1c3e2e81-e169-4afa-8693-c0d0a9ba7610"}], "security_groups": [{"name": "tempest-securitygroup--1189722167"}], "key_name": "tempest-keypair-318266299", "user_data": "}} {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:31:55.999443 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.network.neutron [None req-b4484788-bf1e-4505-8406-76d095593a8d tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] validate_networks() for [('1c3e2e81-e169-4afa-8693-c0d0a9ba7610', None, None, None, None, None)] {{(pid=118741) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 09:31:56.340042 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-1a53c1a0-6906-4816-995f-2a3c620b058d tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:31:56.396571 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-1a53c1a0-6906-4816-995f-2a3c620b058d tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:31:56.396571 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-1a53c1a0-6906-4816-995f-2a3c620b058d tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:56.396571 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-1a53c1a0-6906-4816-995f-2a3c620b058d tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:56.396571 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-1a53c1a0-6906-4816-995f-2a3c620b058d tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:56.397143 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-1a53c1a0-6906-4816-995f-2a3c620b058d tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:56.397226 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.virt.hardware [None req-b4484788-bf1e-4505-8406-76d095593a8d tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Flavor limits 0:0:0 {{(pid=118741) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 09:31:56.397226 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.virt.hardware [None req-b4484788-bf1e-4505-8406-76d095593a8d tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Image limits 0:0:0 {{(pid=118741) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 09:31:56.397226 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.virt.hardware [None req-b4484788-bf1e-4505-8406-76d095593a8d tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Flavor pref 0:0:0 {{(pid=118741) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 09:31:56.397226 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.virt.hardware [None req-b4484788-bf1e-4505-8406-76d095593a8d tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Image pref 0:0:0 {{(pid=118741) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 09:31:56.397226 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.virt.hardware [None req-b4484788-bf1e-4505-8406-76d095593a8d tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118741) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 09:31:56.397928 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b4484788-bf1e-4505-8406-76d095593a8d tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:56.397928 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b4484788-bf1e-4505-8406-76d095593a8d tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:56.397928 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b4484788-bf1e-4505-8406-76d095593a8d tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:56.397928 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b4484788-bf1e-4505-8406-76d095593a8d tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:56.398223 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.quota [None req-b4484788-bf1e-4505-8406-76d095593a8d tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Getting quotas for project 50189b9cf3b145ba84495af8db63c41b. Resources: {'instances', 'cores', 'ram'} {{(pid=118741) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 09:31:56.401888 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.quota [None req-b4484788-bf1e-4505-8406-76d095593a8d tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Getting quotas for user 2f32356bb0bd4234ba817db581b62aad and project 50189b9cf3b145ba84495af8db63c41b. Resources: {'instances', 'cores', 'ram'} {{(pid=118741) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 09:31:56.413605 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-b4484788-bf1e-4505-8406-76d095593a8d tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Going to run 1 instances... {{(pid=118741) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 09:31:56.415891 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-b4484788-bf1e-4505-8406-76d095593a8d tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 0aeeca04-2158-46a0-aabc-80438e18044d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8fdb0275-8c58-4c9e-a2f3-3aae3a947526',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118741) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 09:31:56.479451 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-1a53c1a0-6906-4816-995f-2a3c620b058d tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0346f4e3855142059983083e71c2c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c21b1cbbd604d6d9c97ab7c3c788f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:56.487894 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-1a53c1a0-6906-4816-995f-2a3c620b058d tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25" status: 200 len: 1712 microversion: 2.1 time: 0.152377 Jun 07 09:31:56.488680 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 256/511] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:31:56 2022] GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 => generated 1712 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:31:56.493043 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-b71052c9-e1cf-442b-9dd5-ba94b187139d tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:31:56.497742 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-b71052c9-e1cf-442b-9dd5-ba94b187139d tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] [instance: 0ff9a031-9aa3-45b7-8c07-193836e8acb9] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:31:56.499281 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b71052c9-e1cf-442b-9dd5-ba94b187139d tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:56.499744 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b71052c9-e1cf-442b-9dd5-ba94b187139d tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:56.500515 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b71052c9-e1cf-442b-9dd5-ba94b187139d tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:56.500978 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b71052c9-e1cf-442b-9dd5-ba94b187139d tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:56.513815 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.wsgi [None req-b71052c9-e1cf-442b-9dd5-ba94b187139d tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] HTTP exception thrown: Instance 0ff9a031-9aa3-45b7-8c07-193836e8acb9 could not be found. Jun 07 09:31:56.515923 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-b71052c9-e1cf-442b-9dd5-ba94b187139d tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Request method failure captured: Jun 07 09:31:56.515923 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: request: GET /compute/v2.1/servers/0ff9a031-9aa3-45b7-8c07-193836e8acb9 HTTP/1.1 Jun 07 09:31:56.515923 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Accept: application/json Jun 07 09:31:56.515923 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Accept-Encoding: identity Jun 07 09:31:56.515923 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Connection: close Jun 07 09:31:56.515923 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Content-Length: 0 Jun 07 09:31:56.515923 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Content-Type: application/json Jun 07 09:31:56.515923 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Host: 10.222.0.57 Jun 07 09:31:56.515923 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Openstack-System-Scope: None Jun 07 09:31:56.515923 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: User-Agent: python-urllib3/1.26.9 Jun 07 09:31:56.515923 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Auth-Token: gAAAAABinxraM1ffbm9WNJt6h9xgPWROQ5x_oWYtpTHICvTu9i1WZTT35yocBRvr1Rs01Uqq8huXpfL3IltQtHTVTB47X6KwnOqO5GP9BR1SeWc1B5Cg9HxBoQU9fbYlrakq_Oo9zg-yPx47J2afwcs9o-uDUYsshpiN2Qf6IGJ_WiK7B_FCpoc Jun 07 09:31:56.515923 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Domain-Id: None Jun 07 09:31:56.515923 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Domain-Name: None Jun 07 09:31:56.515923 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Identity-Status: Confirmed Jun 07 09:31:56.515923 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Is-Admin-Project: True Jun 07 09:31:56.515923 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Domain-Id: default Jun 07 09:31:56.515923 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Domain-Name: Default Jun 07 09:31:56.515923 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Id: 76e471342cb24c918197b538b2c8642a Jun 07 09:31:56.515923 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Name: tempest-VolumesActionsTest-1734739318 Jun 07 09:31:56.515923 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Role: reader,member Jun 07 09:31:56.515923 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Roles: reader,member Jun 07 09:31:56.517576 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/76e471342cb24c918197b538b2c8642a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/76e471342cb24c918197b538b2c8642a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_76e471342cb24c918197b538b2c8642a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/76e471342cb24c918197b538b2c8642a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 07 09:31:56.517576 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Tenant: tempest-VolumesActionsTest-1734739318 Jun 07 09:31:56.517576 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Tenant-Id: 76e471342cb24c918197b538b2c8642a Jun 07 09:31:56.517576 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Tenant-Name: tempest-VolumesActionsTest-1734739318 Jun 07 09:31:56.517576 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User: tempest-VolumesActionsTest-1734739318-project Jun 07 09:31:56.517576 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Domain-Id: default Jun 07 09:31:56.517576 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Domain-Name: Default Jun 07 09:31:56.517576 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Id: 7ae6107c814c4bb5a36ba9e80ef875f4 Jun 07 09:31:56.517576 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Name: tempest-VolumesActionsTest-1734739318-project Jun 07 09:31:56.517576 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: method: > Jun 07 09:31:56.517576 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: exception: Instance 0ff9a031-9aa3-45b7-8c07-193836e8acb9 could not be found. Jun 07 09:31:56.517576 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: action_args: {'id': '0ff9a031-9aa3-45b7-8c07-193836e8acb9'} Jun 07 09:31:56.518486 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 09:31:56.518486 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:31:56.518486 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 09:31:56.518486 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 09:31:56.518486 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 09:31:56.518486 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 09:31:56.518486 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 09:31:56.518486 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 09:31:56.518486 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 09:31:56.518486 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 09:31:56.518486 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ff9a031-9aa3-45b7-8c07-193836e8acb9 could not be found. Jun 07 09:31:56.518486 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:31:56.518486 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:31:56.518486 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:31:56.518486 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:31:56.518486 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:31:56.518486 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:31:56.518486 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 09:31:56.518486 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 09:31:56.518486 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 09:31:56.519989 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 09:31:56.519989 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 09:31:56.519989 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 09:31:56.519989 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 09:31:56.519989 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 09:31:56.519989 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 09:31:56.519989 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 09:31:56.519989 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ff9a031-9aa3-45b7-8c07-193836e8acb9 could not be found. Jun 07 09:31:56.519989 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:31:56.519989 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:31:56.519989 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:31:56.519989 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:31:56.519989 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:31:56.519989 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:31:56.519989 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 09:31:56.519989 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 09:31:56.519989 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ff9a031-9aa3-45b7-8c07-193836e8acb9 could not be found. Jun 07 09:31:56.519989 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:31:56.521323 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-b71052c9-e1cf-442b-9dd5-ba94b187139d tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] Returning 404 to user: Instance 0ff9a031-9aa3-45b7-8c07-193836e8acb9 could not be found. {{(pid=118740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 09:31:56.521323 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-b71052c9-e1cf-442b-9dd5-ba94b187139d tempest-VolumesActionsTest-1734739318 tempest-VolumesActionsTest-1734739318-project] 10.222.0.57 "GET /compute/v2.1/servers/0ff9a031-9aa3-45b7-8c07-193836e8acb9" status: 404 len: 111 microversion: 2.1 time: 0.027721 Jun 07 09:31:56.521323 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 257/512] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:31:56 2022] GET /compute/v2.1/servers/0ff9a031-9aa3-45b7-8c07-193836e8acb9 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 09:31:56.601410 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-b4484788-bf1e-4505-8406-76d095593a8d tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.707031 Jun 07 09:31:56.602048 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 256/513] 10.222.0.57 () {60 vars in 1146 bytes} [Tue Jun 7 09:31:55 2022] POST /compute/v2.1/servers => generated 402 bytes in 708 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 09:31:56.612707 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-d4ca98b2-79d8-4e34-ae3b-2f0dba7ce975 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:31:56.613349 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-d4ca98b2-79d8-4e34-ae3b-2f0dba7ce975 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 0aeeca04-2158-46a0-aabc-80438e18044d] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:31:56.636612 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-2a02ac3d-937b-4213-b1f2-6b5ee15a4189 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:31:56.637451 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-2a02ac3d-937b-4213-b1f2-6b5ee15a4189 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:31:56.644161 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-2a02ac3d-937b-4213-b1f2-6b5ee15a4189 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:56.652839 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-2a02ac3d-937b-4213-b1f2-6b5ee15a4189 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:56.652839 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-2a02ac3d-937b-4213-b1f2-6b5ee15a4189 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:56.652839 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-2a02ac3d-937b-4213-b1f2-6b5ee15a4189 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:56.667446 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-d4ca98b2-79d8-4e34-ae3b-2f0dba7ce975 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:56.675131 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-d4ca98b2-79d8-4e34-ae3b-2f0dba7ce975 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/0aeeca04-2158-46a0-aabc-80438e18044d" status: 200 len: 1240 microversion: 2.1 time: 0.066733 Jun 07 09:31:56.687145 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 258/514] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:31:56 2022] GET /compute/v2.1/servers/0aeeca04-2158-46a0-aabc-80438e18044d => generated 1240 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:31:56.794044 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-2a02ac3d-937b-4213-b1f2-6b5ee15a4189 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:56.802799 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-2a02ac3d-937b-4213-b1f2-6b5ee15a4189 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:56.804310 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-2a02ac3d-937b-4213-b1f2-6b5ee15a4189 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:56.805511 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-2a02ac3d-937b-4213-b1f2-6b5ee15a4189 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1720 microversion: 2.20 time: 0.172927 Jun 07 09:31:56.806069 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 257/515] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:31:56 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1720 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 09:31:57.694443 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-35317b19-d00c-4eef-bf34-f2d532d5c0b8 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:31:57.694443 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-35317b19-d00c-4eef-bf34-f2d532d5c0b8 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 0aeeca04-2158-46a0-aabc-80438e18044d] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:31:57.701428 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-35317b19-d00c-4eef-bf34-f2d532d5c0b8 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:57.701931 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-35317b19-d00c-4eef-bf34-f2d532d5c0b8 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:57.703254 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-35317b19-d00c-4eef-bf34-f2d532d5c0b8 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:57.703696 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-35317b19-d00c-4eef-bf34-f2d532d5c0b8 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:57.767161 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-35317b19-d00c-4eef-bf34-f2d532d5c0b8 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:57.774701 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-35317b19-d00c-4eef-bf34-f2d532d5c0b8 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/0aeeca04-2158-46a0-aabc-80438e18044d" status: 200 len: 1244 microversion: 2.1 time: 0.085458 Jun 07 09:31:57.775257 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 259/516] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:31:57 2022] GET /compute/v2.1/servers/0aeeca04-2158-46a0-aabc-80438e18044d => generated 1244 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:31:57.823220 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-cbcf79ed-e3fb-49b0-a024-4b82be7cc3a8 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:31:57.824469 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-cbcf79ed-e3fb-49b0-a024-4b82be7cc3a8 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:31:57.832939 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-cbcf79ed-e3fb-49b0-a024-4b82be7cc3a8 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:57.836123 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-cbcf79ed-e3fb-49b0-a024-4b82be7cc3a8 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:57.836123 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-cbcf79ed-e3fb-49b0-a024-4b82be7cc3a8 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:57.836123 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-cbcf79ed-e3fb-49b0-a024-4b82be7cc3a8 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:57.964941 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-cbcf79ed-e3fb-49b0-a024-4b82be7cc3a8 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:57.973472 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-cbcf79ed-e3fb-49b0-a024-4b82be7cc3a8 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:57.974980 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-cbcf79ed-e3fb-49b0-a024-4b82be7cc3a8 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:57.976128 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-cbcf79ed-e3fb-49b0-a024-4b82be7cc3a8 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1720 microversion: 2.20 time: 0.156935 Jun 07 09:31:57.976705 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 258/517] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:31:57 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:31:58.792009 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-8626c388-b083-480e-8b1b-b8fb04673726 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:31:58.792642 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-8626c388-b083-480e-8b1b-b8fb04673726 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 0aeeca04-2158-46a0-aabc-80438e18044d] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:31:58.799638 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-8626c388-b083-480e-8b1b-b8fb04673726 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:58.800087 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-8626c388-b083-480e-8b1b-b8fb04673726 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:58.800881 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-8626c388-b083-480e-8b1b-b8fb04673726 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:58.801323 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-8626c388-b083-480e-8b1b-b8fb04673726 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:58.864122 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-8626c388-b083-480e-8b1b-b8fb04673726 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:58.871565 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-8626c388-b083-480e-8b1b-b8fb04673726 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/0aeeca04-2158-46a0-aabc-80438e18044d" status: 200 len: 1292 microversion: 2.1 time: 0.083437 Jun 07 09:31:58.872121 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 260/518] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:31:58 2022] GET /compute/v2.1/servers/0aeeca04-2158-46a0-aabc-80438e18044d => generated 1292 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:31:58.994492 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-c8b696f5-d4e6-4ddb-b424-5cdc51786aa1 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:31:58.995092 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-c8b696f5-d4e6-4ddb-b424-5cdc51786aa1 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:31:59.001210 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-c8b696f5-d4e6-4ddb-b424-5cdc51786aa1 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:59.001651 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-c8b696f5-d4e6-4ddb-b424-5cdc51786aa1 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:59.003699 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-c8b696f5-d4e6-4ddb-b424-5cdc51786aa1 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:59.004137 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-c8b696f5-d4e6-4ddb-b424-5cdc51786aa1 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:59.006740 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writing DB stats nova_cell1:SELECT=100 {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:31:59.132149 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-c8b696f5-d4e6-4ddb-b424-5cdc51786aa1 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:59.139962 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-c8b696f5-d4e6-4ddb-b424-5cdc51786aa1 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:59.141475 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-c8b696f5-d4e6-4ddb-b424-5cdc51786aa1 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:59.142757 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-c8b696f5-d4e6-4ddb-b424-5cdc51786aa1 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1720 microversion: 2.20 time: 0.152050 Jun 07 09:31:59.143313 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 259/519] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:31:58 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:31:59.889932 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-7fcc10bb-a221-4a58-87ac-c5cd92c83e7f tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:31:59.890548 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-7fcc10bb-a221-4a58-87ac-c5cd92c83e7f tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 0aeeca04-2158-46a0-aabc-80438e18044d] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:31:59.897128 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-7fcc10bb-a221-4a58-87ac-c5cd92c83e7f tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:59.897581 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-7fcc10bb-a221-4a58-87ac-c5cd92c83e7f tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:59.898352 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-7fcc10bb-a221-4a58-87ac-c5cd92c83e7f tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:31:59.898791 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-7fcc10bb-a221-4a58-87ac-c5cd92c83e7f tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:31:59.957623 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-7fcc10bb-a221-4a58-87ac-c5cd92c83e7f tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:31:59.964894 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-7fcc10bb-a221-4a58-87ac-c5cd92c83e7f tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/0aeeca04-2158-46a0-aabc-80438e18044d" status: 200 len: 1292 microversion: 2.1 time: 0.078772 Jun 07 09:31:59.965458 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 261/520] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:31:59 2022] GET /compute/v2.1/servers/0aeeca04-2158-46a0-aabc-80438e18044d => generated 1292 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:32:00.160901 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-8efcea17-9eb6-477f-b470-6aa6b00f7996 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:32:00.161457 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-8efcea17-9eb6-477f-b470-6aa6b00f7996 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:32:00.167502 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-8efcea17-9eb6-477f-b470-6aa6b00f7996 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:00.167954 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-8efcea17-9eb6-477f-b470-6aa6b00f7996 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:00.168742 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-8efcea17-9eb6-477f-b470-6aa6b00f7996 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:00.169178 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-8efcea17-9eb6-477f-b470-6aa6b00f7996 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:00.295634 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-8efcea17-9eb6-477f-b470-6aa6b00f7996 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:00.304260 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-8efcea17-9eb6-477f-b470-6aa6b00f7996 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:00.305813 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-8efcea17-9eb6-477f-b470-6aa6b00f7996 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:00.306993 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-8efcea17-9eb6-477f-b470-6aa6b00f7996 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1720 microversion: 2.20 time: 0.150621 Jun 07 09:32:00.307546 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 260/521] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:32:00 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:32:00.982524 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-71c56146-8d82-4625-8209-a15ced132c4b tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:32:00.983140 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-71c56146-8d82-4625-8209-a15ced132c4b tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 0aeeca04-2158-46a0-aabc-80438e18044d] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:32:00.989651 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-71c56146-8d82-4625-8209-a15ced132c4b tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:00.990110 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-71c56146-8d82-4625-8209-a15ced132c4b tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:00.990880 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-71c56146-8d82-4625-8209-a15ced132c4b tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:00.991321 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-71c56146-8d82-4625-8209-a15ced132c4b tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:01.053297 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-71c56146-8d82-4625-8209-a15ced132c4b tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:01.060852 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-71c56146-8d82-4625-8209-a15ced132c4b tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/0aeeca04-2158-46a0-aabc-80438e18044d" status: 200 len: 1300 microversion: 2.1 time: 0.082386 Jun 07 09:32:01.061401 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 262/522] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:32:00 2022] GET /compute/v2.1/servers/0aeeca04-2158-46a0-aabc-80438e18044d => generated 1300 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:32:01.325033 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-88bd7b8c-c861-4285-b693-e8ed2bd5883d tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:32:01.325542 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-88bd7b8c-c861-4285-b693-e8ed2bd5883d tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:32:01.331549 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-88bd7b8c-c861-4285-b693-e8ed2bd5883d tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:01.331991 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-88bd7b8c-c861-4285-b693-e8ed2bd5883d tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:01.332765 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-88bd7b8c-c861-4285-b693-e8ed2bd5883d tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:01.333193 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-88bd7b8c-c861-4285-b693-e8ed2bd5883d tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:01.458891 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-88bd7b8c-c861-4285-b693-e8ed2bd5883d tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:01.466873 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-88bd7b8c-c861-4285-b693-e8ed2bd5883d tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:01.468378 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-88bd7b8c-c861-4285-b693-e8ed2bd5883d tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:01.469553 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-88bd7b8c-c861-4285-b693-e8ed2bd5883d tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1720 microversion: 2.20 time: 0.148492 Jun 07 09:32:01.470101 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 261/523] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:32:01 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1720 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:32:02.089033 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-f9112a76-9d94-4da7-9269-3e4cd7e93596 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:32:02.089658 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-f9112a76-9d94-4da7-9269-3e4cd7e93596 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 0aeeca04-2158-46a0-aabc-80438e18044d] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:32:02.096909 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-f9112a76-9d94-4da7-9269-3e4cd7e93596 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:02.097377 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-f9112a76-9d94-4da7-9269-3e4cd7e93596 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:02.098129 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-f9112a76-9d94-4da7-9269-3e4cd7e93596 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:02.098563 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-f9112a76-9d94-4da7-9269-3e4cd7e93596 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:02.159189 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-f9112a76-9d94-4da7-9269-3e4cd7e93596 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:02.166769 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-f9112a76-9d94-4da7-9269-3e4cd7e93596 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/0aeeca04-2158-46a0-aabc-80438e18044d" status: 200 len: 1300 microversion: 2.1 time: 0.081622 Jun 07 09:32:02.167331 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 263/524] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:32:02 2022] GET /compute/v2.1/servers/0aeeca04-2158-46a0-aabc-80438e18044d => generated 1300 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:32:02.487643 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-48e23738-518e-49dc-a98a-5ce469126093 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:32:02.488328 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-48e23738-518e-49dc-a98a-5ce469126093 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:32:02.494468 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-48e23738-518e-49dc-a98a-5ce469126093 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:02.494918 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-48e23738-518e-49dc-a98a-5ce469126093 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:02.495682 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-48e23738-518e-49dc-a98a-5ce469126093 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:02.496119 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-48e23738-518e-49dc-a98a-5ce469126093 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:02.687013 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-48e23738-518e-49dc-a98a-5ce469126093 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:02.695559 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-48e23738-518e-49dc-a98a-5ce469126093 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:02.697098 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-48e23738-518e-49dc-a98a-5ce469126093 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:02.698267 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-48e23738-518e-49dc-a98a-5ce469126093 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1720 microversion: 2.20 time: 0.214686 Jun 07 09:32:02.698837 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 262/525] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:32:02 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1720 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:32:03.184390 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-e3abad8e-a5d2-4df8-8e52-1b92b08c36b3 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:32:03.185166 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-e3abad8e-a5d2-4df8-8e52-1b92b08c36b3 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 0aeeca04-2158-46a0-aabc-80438e18044d] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:32:03.195465 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-e3abad8e-a5d2-4df8-8e52-1b92b08c36b3 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:03.195943 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-e3abad8e-a5d2-4df8-8e52-1b92b08c36b3 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:03.196972 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-e3abad8e-a5d2-4df8-8e52-1b92b08c36b3 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:03.197381 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-e3abad8e-a5d2-4df8-8e52-1b92b08c36b3 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:03.337750 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-e3abad8e-a5d2-4df8-8e52-1b92b08c36b3 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:03.345575 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-e3abad8e-a5d2-4df8-8e52-1b92b08c36b3 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/0aeeca04-2158-46a0-aabc-80438e18044d" status: 200 len: 1366 microversion: 2.1 time: 0.165404 Jun 07 09:32:03.346884 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 264/526] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:32:03 2022] GET /compute/v2.1/servers/0aeeca04-2158-46a0-aabc-80438e18044d => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:32:03.716132 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-6e76455f-d31e-4a2f-b537-c122e09f1968 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:32:03.716879 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-6e76455f-d31e-4a2f-b537-c122e09f1968 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:32:03.723149 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-6e76455f-d31e-4a2f-b537-c122e09f1968 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:03.723682 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-6e76455f-d31e-4a2f-b537-c122e09f1968 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:03.724526 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-6e76455f-d31e-4a2f-b537-c122e09f1968 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:03.725060 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-6e76455f-d31e-4a2f-b537-c122e09f1968 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:03.895792 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-6e76455f-d31e-4a2f-b537-c122e09f1968 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:03.906676 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-6e76455f-d31e-4a2f-b537-c122e09f1968 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:03.908526 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-6e76455f-d31e-4a2f-b537-c122e09f1968 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:03.909917 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-6e76455f-d31e-4a2f-b537-c122e09f1968 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1720 microversion: 2.20 time: 0.197757 Jun 07 09:32:03.910643 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 263/527] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:32:03 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1720 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:32:04.201923 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [req-b4310de5-6569-4837-987a-8e27cd433da8 req-c082a35a-e2cc-41f9-865b-d52a7db8a28f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0aeeca04-2158-46a0-aabc-80438e18044d", "tag": "41c93af3-c807-4234-8e0b-306a52e429c7"}]} {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:32:04.215532 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [req-b4310de5-6569-4837-987a-8e27cd433da8 req-c082a35a-e2cc-41f9-865b-d52a7db8a28f service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:04.217386 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [req-b4310de5-6569-4837-987a-8e27cd433da8 req-c082a35a-e2cc-41f9-865b-d52a7db8a28f service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:04.238868 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.compute.server_external_events [req-b4310de5-6569-4837-987a-8e27cd433da8 req-c082a35a-e2cc-41f9-865b-d52a7db8a28f service nova] Creating event network-changed:41c93af3-c807-4234-8e0b-306a52e429c7 for instance 0aeeca04-2158-46a0-aabc-80438e18044d on hv-cinder-83699 Jun 07 09:32:04.250115 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [req-b4310de5-6569-4837-987a-8e27cd433da8 req-c082a35a-e2cc-41f9-865b-d52a7db8a28f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051436 Jun 07 09:32:04.253671 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 265/528] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Jun 7 09:32:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:32:04.367614 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-22d52e8d-3ee2-46a7-ba82-0193500b5309 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:32:04.368189 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-22d52e8d-3ee2-46a7-ba82-0193500b5309 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 0aeeca04-2158-46a0-aabc-80438e18044d] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:32:04.379096 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-22d52e8d-3ee2-46a7-ba82-0193500b5309 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:04.379834 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-22d52e8d-3ee2-46a7-ba82-0193500b5309 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:04.380841 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-22d52e8d-3ee2-46a7-ba82-0193500b5309 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:04.381744 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-22d52e8d-3ee2-46a7-ba82-0193500b5309 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:04.931637 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-889f5d0e-99f9-4f18-9079-3062adb1031e tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:32:04.938735 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-889f5d0e-99f9-4f18-9079-3062adb1031e tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:32:04.948711 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-889f5d0e-99f9-4f18-9079-3062adb1031e tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:04.949366 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-889f5d0e-99f9-4f18-9079-3062adb1031e tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:04.950594 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-889f5d0e-99f9-4f18-9079-3062adb1031e tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:04.951670 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-889f5d0e-99f9-4f18-9079-3062adb1031e tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:04.980325 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-22d52e8d-3ee2-46a7-ba82-0193500b5309 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:04.999731 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-22d52e8d-3ee2-46a7-ba82-0193500b5309 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/0aeeca04-2158-46a0-aabc-80438e18044d" status: 200 len: 1366 microversion: 2.1 time: 0.636817 Jun 07 09:32:05.013898 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 264/529] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:32:04 2022] GET /compute/v2.1/servers/0aeeca04-2158-46a0-aabc-80438e18044d => generated 1366 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:32:05.157835 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-889f5d0e-99f9-4f18-9079-3062adb1031e tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:05.174930 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-889f5d0e-99f9-4f18-9079-3062adb1031e tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:05.176741 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-889f5d0e-99f9-4f18-9079-3062adb1031e tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:05.178186 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-889f5d0e-99f9-4f18-9079-3062adb1031e tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1720 microversion: 2.20 time: 0.253430 Jun 07 09:32:05.190465 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 266/530] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:32:04 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1720 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 09:32:06.017112 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-b0e6f202-9dec-4b3a-bc90-598246e71433 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:32:06.018407 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-b0e6f202-9dec-4b3a-bc90-598246e71433 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 0aeeca04-2158-46a0-aabc-80438e18044d] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:32:06.027112 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b0e6f202-9dec-4b3a-bc90-598246e71433 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:06.027796 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b0e6f202-9dec-4b3a-bc90-598246e71433 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:06.029045 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b0e6f202-9dec-4b3a-bc90-598246e71433 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:06.029653 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b0e6f202-9dec-4b3a-bc90-598246e71433 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:06.184573 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-b0e6f202-9dec-4b3a-bc90-598246e71433 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:06.196124 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-8d691747-9a65-4a9c-8007-832965792b28 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:32:06.197268 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-8d691747-9a65-4a9c-8007-832965792b28 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:32:06.202977 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-b0e6f202-9dec-4b3a-bc90-598246e71433 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/0aeeca04-2158-46a0-aabc-80438e18044d" status: 200 len: 1366 microversion: 2.1 time: 0.189613 Jun 07 09:32:06.205926 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-8d691747-9a65-4a9c-8007-832965792b28 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:06.206791 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-8d691747-9a65-4a9c-8007-832965792b28 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:06.207793 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-8d691747-9a65-4a9c-8007-832965792b28 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:06.208443 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-8d691747-9a65-4a9c-8007-832965792b28 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:06.211843 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 265/531] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:32:06 2022] GET /compute/v2.1/servers/0aeeca04-2158-46a0-aabc-80438e18044d => generated 1366 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:32:06.235343 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:32:06.363360 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-8d691747-9a65-4a9c-8007-832965792b28 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:06.374059 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-8d691747-9a65-4a9c-8007-832965792b28 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:06.376670 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-8d691747-9a65-4a9c-8007-832965792b28 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:06.378698 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-8d691747-9a65-4a9c-8007-832965792b28 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1720 microversion: 2.20 time: 0.186213 Jun 07 09:32:06.379971 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 267/532] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:32:06 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1720 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:32:07.224003 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-317f16b7-f760-43f6-a197-78b379bb5a4f tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:32:07.224652 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-317f16b7-f760-43f6-a197-78b379bb5a4f tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 0aeeca04-2158-46a0-aabc-80438e18044d] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:32:07.226538 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writing DB stats nova_cell0:SELECT=2 {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:32:07.227187 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writing DB stats nova_cell0:SELECT=6 {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:32:07.235355 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-317f16b7-f760-43f6-a197-78b379bb5a4f tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:07.235811 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-317f16b7-f760-43f6-a197-78b379bb5a4f tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:07.236677 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-317f16b7-f760-43f6-a197-78b379bb5a4f tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:07.237125 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-317f16b7-f760-43f6-a197-78b379bb5a4f tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:07.386455 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-317f16b7-f760-43f6-a197-78b379bb5a4f tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:07.396720 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-317f16b7-f760-43f6-a197-78b379bb5a4f tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/0aeeca04-2158-46a0-aabc-80438e18044d" status: 200 len: 1366 microversion: 2.1 time: 0.177312 Jun 07 09:32:07.397792 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 266/533] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:32:07 2022] GET /compute/v2.1/servers/0aeeca04-2158-46a0-aabc-80438e18044d => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:32:07.412848 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-9bf1f61b-04fd-4008-98a6-713d9cce139e tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:32:07.418724 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-9bf1f61b-04fd-4008-98a6-713d9cce139e tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:32:07.427213 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writing DB stats nova_cell0:SELECT=6 {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:32:07.430112 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-9bf1f61b-04fd-4008-98a6-713d9cce139e tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:07.430565 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-9bf1f61b-04fd-4008-98a6-713d9cce139e tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:07.431366 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-9bf1f61b-04fd-4008-98a6-713d9cce139e tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:07.431807 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-9bf1f61b-04fd-4008-98a6-713d9cce139e tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:07.591960 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-9bf1f61b-04fd-4008-98a6-713d9cce139e tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:07.601932 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-9bf1f61b-04fd-4008-98a6-713d9cce139e tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:07.603458 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-9bf1f61b-04fd-4008-98a6-713d9cce139e tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:07.604855 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-9bf1f61b-04fd-4008-98a6-713d9cce139e tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1720 microversion: 2.20 time: 0.210221 Jun 07 09:32:07.605622 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 268/534] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:32:07 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1720 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 09:32:08.415959 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-afc9fafd-cfca-4ab1-80e3-fe97f8f9975e tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:32:08.417300 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-afc9fafd-cfca-4ab1-80e3-fe97f8f9975e tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 0aeeca04-2158-46a0-aabc-80438e18044d] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:32:08.425205 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-afc9fafd-cfca-4ab1-80e3-fe97f8f9975e tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:08.425658 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-afc9fafd-cfca-4ab1-80e3-fe97f8f9975e tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:08.426432 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-afc9fafd-cfca-4ab1-80e3-fe97f8f9975e tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:08.426869 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-afc9fafd-cfca-4ab1-80e3-fe97f8f9975e tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:08.573178 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-afc9fafd-cfca-4ab1-80e3-fe97f8f9975e tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:08.581297 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-afc9fafd-cfca-4ab1-80e3-fe97f8f9975e tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/0aeeca04-2158-46a0-aabc-80438e18044d" status: 200 len: 1366 microversion: 2.1 time: 0.170531 Jun 07 09:32:08.581865 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 267/535] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:32:08 2022] GET /compute/v2.1/servers/0aeeca04-2158-46a0-aabc-80438e18044d => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:32:08.623256 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-f4f2ebae-0fd1-4351-afa4-3deea0d934d5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:32:08.623870 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-f4f2ebae-0fd1-4351-afa4-3deea0d934d5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:32:08.632121 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-f4f2ebae-0fd1-4351-afa4-3deea0d934d5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:08.632821 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-f4f2ebae-0fd1-4351-afa4-3deea0d934d5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:08.633943 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-f4f2ebae-0fd1-4351-afa4-3deea0d934d5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:08.634584 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-f4f2ebae-0fd1-4351-afa4-3deea0d934d5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:08.791105 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-f4f2ebae-0fd1-4351-afa4-3deea0d934d5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:08.799980 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-f4f2ebae-0fd1-4351-afa4-3deea0d934d5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:08.802024 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-f4f2ebae-0fd1-4351-afa4-3deea0d934d5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:08.803361 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-f4f2ebae-0fd1-4351-afa4-3deea0d934d5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1720 microversion: 2.20 time: 0.184037 Jun 07 09:32:08.814970 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 269/536] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:32:08 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1720 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:32:09.602797 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-cada1e1b-4f52-4a41-b7e9-6989a89bc7ee tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:32:09.603575 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-cada1e1b-4f52-4a41-b7e9-6989a89bc7ee tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 0aeeca04-2158-46a0-aabc-80438e18044d] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:32:09.610487 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-cada1e1b-4f52-4a41-b7e9-6989a89bc7ee tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:09.611722 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-cada1e1b-4f52-4a41-b7e9-6989a89bc7ee tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:09.612504 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-cada1e1b-4f52-4a41-b7e9-6989a89bc7ee tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:09.613145 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-cada1e1b-4f52-4a41-b7e9-6989a89bc7ee tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:09.766767 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-cada1e1b-4f52-4a41-b7e9-6989a89bc7ee tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:09.774077 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-cada1e1b-4f52-4a41-b7e9-6989a89bc7ee tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/0aeeca04-2158-46a0-aabc-80438e18044d" status: 200 len: 1366 microversion: 2.1 time: 0.177363 Jun 07 09:32:09.774629 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 268/537] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:32:09 2022] GET /compute/v2.1/servers/0aeeca04-2158-46a0-aabc-80438e18044d => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:32:09.821286 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-89e995d6-ef88-4dd1-b693-d45f8f67a2fa tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:32:09.821900 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-89e995d6-ef88-4dd1-b693-d45f8f67a2fa tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:32:09.828510 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-89e995d6-ef88-4dd1-b693-d45f8f67a2fa tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:09.828995 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-89e995d6-ef88-4dd1-b693-d45f8f67a2fa tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:09.829779 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-89e995d6-ef88-4dd1-b693-d45f8f67a2fa tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:09.830223 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-89e995d6-ef88-4dd1-b693-d45f8f67a2fa tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:09.981526 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-89e995d6-ef88-4dd1-b693-d45f8f67a2fa tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:09.991336 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-89e995d6-ef88-4dd1-b693-d45f8f67a2fa tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:09.993306 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-89e995d6-ef88-4dd1-b693-d45f8f67a2fa tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:09.994513 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-89e995d6-ef88-4dd1-b693-d45f8f67a2fa tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1720 microversion: 2.20 time: 0.177246 Jun 07 09:32:09.995068 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 270/538] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:32:09 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1720 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:32:10.791623 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-95fbb5bf-67ca-4157-8794-cd26be05c2fc tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:32:10.793518 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-95fbb5bf-67ca-4157-8794-cd26be05c2fc tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 0aeeca04-2158-46a0-aabc-80438e18044d] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:32:10.798339 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3 {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:32:10.800750 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-95fbb5bf-67ca-4157-8794-cd26be05c2fc tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:10.801476 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-95fbb5bf-67ca-4157-8794-cd26be05c2fc tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:10.802725 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-95fbb5bf-67ca-4157-8794-cd26be05c2fc tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:10.803482 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-95fbb5bf-67ca-4157-8794-cd26be05c2fc tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:10.983004 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-95fbb5bf-67ca-4157-8794-cd26be05c2fc tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:10.993782 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-95fbb5bf-67ca-4157-8794-cd26be05c2fc tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/0aeeca04-2158-46a0-aabc-80438e18044d" status: 200 len: 1366 microversion: 2.1 time: 0.206082 Jun 07 09:32:10.994699 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 269/539] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:32:10 2022] GET /compute/v2.1/servers/0aeeca04-2158-46a0-aabc-80438e18044d => generated 1366 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:32:11.021839 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-68d67497-4d71-4f94-9468-2654a7c759a2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:32:11.022735 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-68d67497-4d71-4f94-9468-2654a7c759a2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:32:11.029781 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-68d67497-4d71-4f94-9468-2654a7c759a2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:11.030356 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-68d67497-4d71-4f94-9468-2654a7c759a2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:11.031217 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-68d67497-4d71-4f94-9468-2654a7c759a2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:11.031907 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-68d67497-4d71-4f94-9468-2654a7c759a2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:11.214294 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-68d67497-4d71-4f94-9468-2654a7c759a2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:11.224445 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-68d67497-4d71-4f94-9468-2654a7c759a2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:11.226597 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-68d67497-4d71-4f94-9468-2654a7c759a2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:11.228088 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-68d67497-4d71-4f94-9468-2654a7c759a2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1741 microversion: 2.20 time: 0.213335 Jun 07 09:32:11.240452 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 271/540] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:32:11 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1741 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:32:12.016871 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-3ab582c5-8818-4bc3-adf6-43209a191a84 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:32:12.020807 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-3ab582c5-8818-4bc3-adf6-43209a191a84 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 0aeeca04-2158-46a0-aabc-80438e18044d] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:32:12.037497 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-3ab582c5-8818-4bc3-adf6-43209a191a84 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:12.043094 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-3ab582c5-8818-4bc3-adf6-43209a191a84 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:12.043094 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-3ab582c5-8818-4bc3-adf6-43209a191a84 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:12.043094 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-3ab582c5-8818-4bc3-adf6-43209a191a84 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:12.191007 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-3ab582c5-8818-4bc3-adf6-43209a191a84 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:12.200134 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-3ab582c5-8818-4bc3-adf6-43209a191a84 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/0aeeca04-2158-46a0-aabc-80438e18044d" status: 200 len: 1366 microversion: 2.1 time: 0.188527 Jun 07 09:32:12.209602 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 270/541] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:32:12 2022] GET /compute/v2.1/servers/0aeeca04-2158-46a0-aabc-80438e18044d => generated 1366 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:32:12.247712 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-37ca655c-1115-4788-ab3e-933d60e6e48a tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:32:12.248393 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-37ca655c-1115-4788-ab3e-933d60e6e48a tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:32:12.255374 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-37ca655c-1115-4788-ab3e-933d60e6e48a tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:12.256168 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-37ca655c-1115-4788-ab3e-933d60e6e48a tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:12.257390 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-37ca655c-1115-4788-ab3e-933d60e6e48a tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:12.258588 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-37ca655c-1115-4788-ab3e-933d60e6e48a tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:12.445504 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-37ca655c-1115-4788-ab3e-933d60e6e48a tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:12.449724 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [req-84403148-59e4-4ec0-a78a-3ec129081b94 req-11db1892-e68b-451c-9892-8d95af50a565 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0aeeca04-2158-46a0-aabc-80438e18044d", "name": "network-vif-plugged", "status": "completed", "tag": "41c93af3-c807-4234-8e0b-306a52e429c7"}]} {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:32:12.454162 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-37ca655c-1115-4788-ab3e-933d60e6e48a tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:12.456183 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-37ca655c-1115-4788-ab3e-933d60e6e48a tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:12.457394 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-37ca655c-1115-4788-ab3e-933d60e6e48a tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1741 microversion: 2.20 time: 0.214052 Jun 07 09:32:12.457944 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 272/542] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:32:12 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1741 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:32:12.459073 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [req-84403148-59e4-4ec0-a78a-3ec129081b94 req-11db1892-e68b-451c-9892-8d95af50a565 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:12.459653 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [req-84403148-59e4-4ec0-a78a-3ec129081b94 req-11db1892-e68b-451c-9892-8d95af50a565 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:12.471514 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.compute.server_external_events [req-84403148-59e4-4ec0-a78a-3ec129081b94 req-11db1892-e68b-451c-9892-8d95af50a565 service nova] Creating event network-vif-plugged:41c93af3-c807-4234-8e0b-306a52e429c7 for instance 0aeeca04-2158-46a0-aabc-80438e18044d on hv-cinder-83699 Jun 07 09:32:12.476784 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [req-84403148-59e4-4ec0-a78a-3ec129081b94 req-11db1892-e68b-451c-9892-8d95af50a565 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031196 Jun 07 09:32:12.477649 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 271/543] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Jun 7 09:32:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 09:32:13.217853 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-1640d4a5-f7de-4ddb-acba-6655551c99b1 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:32:13.218602 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-1640d4a5-f7de-4ddb-acba-6655551c99b1 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 0aeeca04-2158-46a0-aabc-80438e18044d] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:32:13.227311 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-1640d4a5-f7de-4ddb-acba-6655551c99b1 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:13.228009 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-1640d4a5-f7de-4ddb-acba-6655551c99b1 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:13.228829 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-1640d4a5-f7de-4ddb-acba-6655551c99b1 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:13.229268 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-1640d4a5-f7de-4ddb-acba-6655551c99b1 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:13.388628 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-1640d4a5-f7de-4ddb-acba-6655551c99b1 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:13.396544 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-1640d4a5-f7de-4ddb-acba-6655551c99b1 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/0aeeca04-2158-46a0-aabc-80438e18044d" status: 200 len: 1366 microversion: 2.1 time: 0.182875 Jun 07 09:32:13.397168 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 273/544] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:32:13 2022] GET /compute/v2.1/servers/0aeeca04-2158-46a0-aabc-80438e18044d => generated 1366 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:32:13.476559 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-87021dec-dfc1-4f24-95e9-01b1ec7a2885 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:32:13.478028 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-87021dec-dfc1-4f24-95e9-01b1ec7a2885 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:32:13.487363 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-87021dec-dfc1-4f24-95e9-01b1ec7a2885 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:13.487363 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-87021dec-dfc1-4f24-95e9-01b1ec7a2885 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:13.488201 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-87021dec-dfc1-4f24-95e9-01b1ec7a2885 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:13.488569 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-87021dec-dfc1-4f24-95e9-01b1ec7a2885 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:13.667631 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-87021dec-dfc1-4f24-95e9-01b1ec7a2885 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:13.677719 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-87021dec-dfc1-4f24-95e9-01b1ec7a2885 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:13.679476 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-87021dec-dfc1-4f24-95e9-01b1ec7a2885 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:13.681036 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-87021dec-dfc1-4f24-95e9-01b1ec7a2885 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1741 microversion: 2.20 time: 0.208694 Jun 07 09:32:13.693529 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 272/545] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:32:13 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1741 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 09:32:14.417432 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-538737f6-f2b2-457f-a946-3d7575048d7e tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:32:14.419464 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-538737f6-f2b2-457f-a946-3d7575048d7e tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 0aeeca04-2158-46a0-aabc-80438e18044d] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:32:14.426985 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-538737f6-f2b2-457f-a946-3d7575048d7e tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:14.427516 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-538737f6-f2b2-457f-a946-3d7575048d7e tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:14.428527 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-538737f6-f2b2-457f-a946-3d7575048d7e tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:14.429200 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-538737f6-f2b2-457f-a946-3d7575048d7e tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:14.591593 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-538737f6-f2b2-457f-a946-3d7575048d7e tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:14.609610 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-538737f6-f2b2-457f-a946-3d7575048d7e tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/0aeeca04-2158-46a0-aabc-80438e18044d" status: 200 len: 1366 microversion: 2.1 time: 0.197986 Jun 07 09:32:14.620006 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 274/546] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:32:14 2022] GET /compute/v2.1/servers/0aeeca04-2158-46a0-aabc-80438e18044d => generated 1366 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:32:14.700792 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-e4a62ae2-f3cd-49d9-a454-df008021cf93 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:32:14.701391 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-e4a62ae2-f3cd-49d9-a454-df008021cf93 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:32:14.708172 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-e4a62ae2-f3cd-49d9-a454-df008021cf93 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:14.708844 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-e4a62ae2-f3cd-49d9-a454-df008021cf93 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:14.709588 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-e4a62ae2-f3cd-49d9-a454-df008021cf93 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:14.710166 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-e4a62ae2-f3cd-49d9-a454-df008021cf93 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:14.858264 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-e4a62ae2-f3cd-49d9-a454-df008021cf93 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:14.867186 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-e4a62ae2-f3cd-49d9-a454-df008021cf93 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:14.868821 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-e4a62ae2-f3cd-49d9-a454-df008021cf93 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:14.870448 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-e4a62ae2-f3cd-49d9-a454-df008021cf93 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1741 microversion: 2.20 time: 0.173586 Jun 07 09:32:14.883152 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 273/547] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:32:14 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1741 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:32:15.627692 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-74b2fdf6-0f48-48c1-8c55-a84f1f6e07a1 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:32:15.628604 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-74b2fdf6-0f48-48c1-8c55-a84f1f6e07a1 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 0aeeca04-2158-46a0-aabc-80438e18044d] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:32:15.631232 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:32:15.637081 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-74b2fdf6-0f48-48c1-8c55-a84f1f6e07a1 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:15.640419 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-74b2fdf6-0f48-48c1-8c55-a84f1f6e07a1 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:15.640419 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-74b2fdf6-0f48-48c1-8c55-a84f1f6e07a1 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:15.640419 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-74b2fdf6-0f48-48c1-8c55-a84f1f6e07a1 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:15.791731 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-74b2fdf6-0f48-48c1-8c55-a84f1f6e07a1 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:15.800418 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-74b2fdf6-0f48-48c1-8c55-a84f1f6e07a1 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/0aeeca04-2158-46a0-aabc-80438e18044d" status: 200 len: 1366 microversion: 2.1 time: 0.177310 Jun 07 09:32:15.809594 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 275/548] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:32:15 2022] GET /compute/v2.1/servers/0aeeca04-2158-46a0-aabc-80438e18044d => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:32:15.889510 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-bd978210-6feb-4b45-b21e-d7d2c22b5fd7 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:32:15.890754 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-bd978210-6feb-4b45-b21e-d7d2c22b5fd7 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:32:15.897697 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-bd978210-6feb-4b45-b21e-d7d2c22b5fd7 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:15.898373 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-bd978210-6feb-4b45-b21e-d7d2c22b5fd7 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:15.899218 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-bd978210-6feb-4b45-b21e-d7d2c22b5fd7 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:15.899686 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-bd978210-6feb-4b45-b21e-d7d2c22b5fd7 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:16.041953 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-bd978210-6feb-4b45-b21e-d7d2c22b5fd7 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:16.051021 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-bd978210-6feb-4b45-b21e-d7d2c22b5fd7 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:16.052911 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-bd978210-6feb-4b45-b21e-d7d2c22b5fd7 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:16.053915 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-bd978210-6feb-4b45-b21e-d7d2c22b5fd7 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1741 microversion: 2.20 time: 0.168267 Jun 07 09:32:16.054657 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 274/549] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:32:15 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1741 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:32:16.395153 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [req-725c3b3e-9209-4cf6-a133-4cbe09522968 req-0b73656f-7a8f-4b87-bca6-40c3be0c088d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "102039c7-8224-43f7-9fb8-90b82968cfa2", "name": "network-vif-plugged", "status": "completed", "tag": "647bfcc4-5bf0-429c-803e-b72ea4c0fa25"}]} {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:32:16.404959 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [req-725c3b3e-9209-4cf6-a133-4cbe09522968 req-0b73656f-7a8f-4b87-bca6-40c3be0c088d service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:16.405468 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [req-725c3b3e-9209-4cf6-a133-4cbe09522968 req-0b73656f-7a8f-4b87-bca6-40c3be0c088d service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:16.418167 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.compute.server_external_events [req-725c3b3e-9209-4cf6-a133-4cbe09522968 req-0b73656f-7a8f-4b87-bca6-40c3be0c088d service nova] Creating event network-vif-plugged:647bfcc4-5bf0-429c-803e-b72ea4c0fa25 for instance 102039c7-8224-43f7-9fb8-90b82968cfa2 on hv-cinder-83699 Jun 07 09:32:16.423575 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [req-725c3b3e-9209-4cf6-a133-4cbe09522968 req-0b73656f-7a8f-4b87-bca6-40c3be0c088d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032527 Jun 07 09:32:16.424494 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 276/550] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Jun 7 09:32:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 09:32:16.817491 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-0a8008b6-8b1d-4af2-9eda-0e660a213fec tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:32:16.818100 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-0a8008b6-8b1d-4af2-9eda-0e660a213fec tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 0aeeca04-2158-46a0-aabc-80438e18044d] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:32:16.824410 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-0a8008b6-8b1d-4af2-9eda-0e660a213fec tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:16.827400 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-0a8008b6-8b1d-4af2-9eda-0e660a213fec tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:16.827400 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-0a8008b6-8b1d-4af2-9eda-0e660a213fec tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:16.827400 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-0a8008b6-8b1d-4af2-9eda-0e660a213fec tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:16.995905 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-0a8008b6-8b1d-4af2-9eda-0e660a213fec tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:17.004859 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-0a8008b6-8b1d-4af2-9eda-0e660a213fec tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/0aeeca04-2158-46a0-aabc-80438e18044d" status: 200 len: 1555 microversion: 2.1 time: 0.192070 Jun 07 09:32:17.007815 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 275/551] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:32:16 2022] GET /compute/v2.1/servers/0aeeca04-2158-46a0-aabc-80438e18044d => generated 1555 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:32:17.026609 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-1d230338-0a77-4758-b08f-df6e2879f23f tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:32:17.027698 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-1d230338-0a77-4758-b08f-df6e2879f23f tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 0aeeca04-2158-46a0-aabc-80438e18044d] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:32:17.036353 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-1d230338-0a77-4758-b08f-df6e2879f23f tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:17.038119 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-1d230338-0a77-4758-b08f-df6e2879f23f tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:17.043728 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-1d230338-0a77-4758-b08f-df6e2879f23f tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:17.043951 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-1d230338-0a77-4758-b08f-df6e2879f23f tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:17.072536 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-12764596-65ac-4e04-aefb-b80e58f637c1 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:32:17.073198 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-12764596-65ac-4e04-aefb-b80e58f637c1 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:32:17.086116 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-12764596-65ac-4e04-aefb-b80e58f637c1 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:17.089402 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-12764596-65ac-4e04-aefb-b80e58f637c1 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:17.089402 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-12764596-65ac-4e04-aefb-b80e58f637c1 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:17.089402 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-12764596-65ac-4e04-aefb-b80e58f637c1 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:17.120226 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writing DB stats nova_cell1:SELECT=100 {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:32:17.165217 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-1d230338-0a77-4758-b08f-df6e2879f23f tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/0aeeca04-2158-46a0-aabc-80438e18044d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.143141 Jun 07 09:32:17.172329 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 277/552] 10.222.0.57 () {58 vars in 1274 bytes} [Tue Jun 7 09:32:17 2022] GET /compute/v2.1/servers/0aeeca04-2158-46a0-aabc-80438e18044d/os-interface => generated 284 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:32:17.303517 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-12764596-65ac-4e04-aefb-b80e58f637c1 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:17.311899 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-12764596-65ac-4e04-aefb-b80e58f637c1 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:17.313430 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-12764596-65ac-4e04-aefb-b80e58f637c1 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:17.316224 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-12764596-65ac-4e04-aefb-b80e58f637c1 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1736 microversion: 2.20 time: 0.247904 Jun 07 09:32:17.326741 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 276/553] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:32:17 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1736 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 09:32:18.351690 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-28a63f19-271c-4566-a11f-02d3e0bf0fd3 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:32:18.355041 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-28a63f19-271c-4566-a11f-02d3e0bf0fd3 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:32:18.367892 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-28a63f19-271c-4566-a11f-02d3e0bf0fd3 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:18.368963 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-28a63f19-271c-4566-a11f-02d3e0bf0fd3 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:18.370013 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-28a63f19-271c-4566-a11f-02d3e0bf0fd3 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:18.370631 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-28a63f19-271c-4566-a11f-02d3e0bf0fd3 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:18.830698 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-28a63f19-271c-4566-a11f-02d3e0bf0fd3 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:18.851131 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-28a63f19-271c-4566-a11f-02d3e0bf0fd3 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:18.852741 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-28a63f19-271c-4566-a11f-02d3e0bf0fd3 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:18.853933 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-28a63f19-271c-4566-a11f-02d3e0bf0fd3 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1736 microversion: 2.20 time: 0.519856 Jun 07 09:32:18.875237 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 278/554] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:32:18 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1736 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:32:19.087524 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [req-92ca8c47-f5fc-469a-bcf6-7a761fc11264 req-a7d5365a-7353-4d20-bd2a-f076099491b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0aeeca04-2158-46a0-aabc-80438e18044d", "tag": "41c93af3-c807-4234-8e0b-306a52e429c7"}]} {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:32:19.109127 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [req-92ca8c47-f5fc-469a-bcf6-7a761fc11264 req-a7d5365a-7353-4d20-bd2a-f076099491b4 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:19.109985 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [req-92ca8c47-f5fc-469a-bcf6-7a761fc11264 req-a7d5365a-7353-4d20-bd2a-f076099491b4 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:19.126988 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.compute.server_external_events [req-92ca8c47-f5fc-469a-bcf6-7a761fc11264 req-a7d5365a-7353-4d20-bd2a-f076099491b4 service nova] Creating event network-changed:41c93af3-c807-4234-8e0b-306a52e429c7 for instance 0aeeca04-2158-46a0-aabc-80438e18044d on hv-cinder-83699 Jun 07 09:32:19.133467 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [req-92ca8c47-f5fc-469a-bcf6-7a761fc11264 req-a7d5365a-7353-4d20-bd2a-f076099491b4 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050760 Jun 07 09:32:19.134548 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 277/555] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Jun 7 09:32:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:32:19.874578 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-d1db6b68-0c6f-4f91-8f29-7edfa805353f tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:32:19.878263 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-d1db6b68-0c6f-4f91-8f29-7edfa805353f tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:32:19.893738 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-d1db6b68-0c6f-4f91-8f29-7edfa805353f tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:19.899359 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-d1db6b68-0c6f-4f91-8f29-7edfa805353f tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:19.899359 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-d1db6b68-0c6f-4f91-8f29-7edfa805353f tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:19.899359 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-d1db6b68-0c6f-4f91-8f29-7edfa805353f tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:20.146663 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-d1db6b68-0c6f-4f91-8f29-7edfa805353f tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:20.155722 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-d1db6b68-0c6f-4f91-8f29-7edfa805353f tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:20.157437 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-d1db6b68-0c6f-4f91-8f29-7edfa805353f tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:20.159845 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-d1db6b68-0c6f-4f91-8f29-7edfa805353f tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1736 microversion: 2.20 time: 0.290766 Jun 07 09:32:20.171321 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 279/556] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:32:19 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1736 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:32:21.179128 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-0e7aab6e-a3c1-4711-80c6-8f4acae67c5b tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:32:21.180441 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-0e7aab6e-a3c1-4711-80c6-8f4acae67c5b tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:32:21.207637 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-0e7aab6e-a3c1-4711-80c6-8f4acae67c5b tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:21.208082 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-0e7aab6e-a3c1-4711-80c6-8f4acae67c5b tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:21.208879 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-0e7aab6e-a3c1-4711-80c6-8f4acae67c5b tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:21.209310 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-0e7aab6e-a3c1-4711-80c6-8f4acae67c5b tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:21.356316 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-0e7aab6e-a3c1-4711-80c6-8f4acae67c5b tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:21.364954 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-0e7aab6e-a3c1-4711-80c6-8f4acae67c5b tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:21.366448 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-0e7aab6e-a3c1-4711-80c6-8f4acae67c5b tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:21.367599 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-0e7aab6e-a3c1-4711-80c6-8f4acae67c5b tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1736 microversion: 2.20 time: 0.192739 Jun 07 09:32:21.368154 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 278/557] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:32:21 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1736 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:32:22.389176 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-373f8f85-986e-45d0-9e0e-2d7ebda024b5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:32:22.389832 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-373f8f85-986e-45d0-9e0e-2d7ebda024b5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:32:22.403589 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-373f8f85-986e-45d0-9e0e-2d7ebda024b5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:22.404406 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-373f8f85-986e-45d0-9e0e-2d7ebda024b5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:22.407812 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-373f8f85-986e-45d0-9e0e-2d7ebda024b5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:22.408462 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-373f8f85-986e-45d0-9e0e-2d7ebda024b5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:22.564100 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-373f8f85-986e-45d0-9e0e-2d7ebda024b5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:22.574035 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-373f8f85-986e-45d0-9e0e-2d7ebda024b5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:22.575821 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-373f8f85-986e-45d0-9e0e-2d7ebda024b5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:22.577016 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-373f8f85-986e-45d0-9e0e-2d7ebda024b5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1736 microversion: 2.20 time: 0.194894 Jun 07 09:32:22.577563 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 280/558] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:32:22 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1736 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:32:23.595720 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-ea137765-1b50-4bfb-9f03-5bab078340bc tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:32:23.596496 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-ea137765-1b50-4bfb-9f03-5bab078340bc tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:32:23.608374 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-ea137765-1b50-4bfb-9f03-5bab078340bc tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:23.608953 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-ea137765-1b50-4bfb-9f03-5bab078340bc tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:23.609898 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-ea137765-1b50-4bfb-9f03-5bab078340bc tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:23.610437 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-ea137765-1b50-4bfb-9f03-5bab078340bc tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:23.806638 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-ea137765-1b50-4bfb-9f03-5bab078340bc tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:23.816699 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-ea137765-1b50-4bfb-9f03-5bab078340bc tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:23.818938 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-ea137765-1b50-4bfb-9f03-5bab078340bc tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:23.820255 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-ea137765-1b50-4bfb-9f03-5bab078340bc tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1736 microversion: 2.20 time: 0.229242 Jun 07 09:32:23.820870 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 279/559] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:32:23 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1736 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:32:24.842658 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-867d79a4-4d65-4615-bcf9-0703fc498ee0 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:32:24.843488 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-867d79a4-4d65-4615-bcf9-0703fc498ee0 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:32:24.858229 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-867d79a4-4d65-4615-bcf9-0703fc498ee0 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:24.858229 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-867d79a4-4d65-4615-bcf9-0703fc498ee0 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:24.858229 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-867d79a4-4d65-4615-bcf9-0703fc498ee0 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:24.858229 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-867d79a4-4d65-4615-bcf9-0703fc498ee0 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:25.015029 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-867d79a4-4d65-4615-bcf9-0703fc498ee0 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:25.025741 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-867d79a4-4d65-4615-bcf9-0703fc498ee0 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:25.027254 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-867d79a4-4d65-4615-bcf9-0703fc498ee0 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:25.028496 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-867d79a4-4d65-4615-bcf9-0703fc498ee0 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1736 microversion: 2.20 time: 0.194093 Jun 07 09:32:25.039194 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 281/560] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:32:24 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1736 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:32:26.057232 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-dac2054d-3368-4805-b2cd-65c72ac00b83 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:32:26.057845 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-dac2054d-3368-4805-b2cd-65c72ac00b83 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:32:26.065332 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-dac2054d-3368-4805-b2cd-65c72ac00b83 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:26.065781 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-dac2054d-3368-4805-b2cd-65c72ac00b83 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:26.066688 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-dac2054d-3368-4805-b2cd-65c72ac00b83 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:26.067130 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-dac2054d-3368-4805-b2cd-65c72ac00b83 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:26.244673 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-dac2054d-3368-4805-b2cd-65c72ac00b83 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:26.254100 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-dac2054d-3368-4805-b2cd-65c72ac00b83 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:26.255746 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-dac2054d-3368-4805-b2cd-65c72ac00b83 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:26.257007 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-dac2054d-3368-4805-b2cd-65c72ac00b83 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1736 microversion: 2.20 time: 0.214292 Jun 07 09:32:26.257743 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 280/561] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:32:26 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1736 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:32:27.276066 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-59e822b9-68f3-4aac-a7a9-4fdbaa3e7f23 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:32:27.277132 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-59e822b9-68f3-4aac-a7a9-4fdbaa3e7f23 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:32:27.285975 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-59e822b9-68f3-4aac-a7a9-4fdbaa3e7f23 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:27.286458 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-59e822b9-68f3-4aac-a7a9-4fdbaa3e7f23 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:27.287231 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-59e822b9-68f3-4aac-a7a9-4fdbaa3e7f23 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:27.287663 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-59e822b9-68f3-4aac-a7a9-4fdbaa3e7f23 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:27.454109 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-59e822b9-68f3-4aac-a7a9-4fdbaa3e7f23 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:27.463484 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-59e822b9-68f3-4aac-a7a9-4fdbaa3e7f23 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:27.465344 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-59e822b9-68f3-4aac-a7a9-4fdbaa3e7f23 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:27.466653 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-59e822b9-68f3-4aac-a7a9-4fdbaa3e7f23 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1736 microversion: 2.20 time: 0.194500 Jun 07 09:32:27.467296 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 282/562] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:32:27 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1736 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:32:28.487387 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-9cf75c72-0549-4dbe-9c6c-e5fb8cde245e tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:32:28.487962 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-9cf75c72-0549-4dbe-9c6c-e5fb8cde245e tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:32:28.494290 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-9cf75c72-0549-4dbe-9c6c-e5fb8cde245e tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:28.494750 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-9cf75c72-0549-4dbe-9c6c-e5fb8cde245e tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:28.495518 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-9cf75c72-0549-4dbe-9c6c-e5fb8cde245e tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:28.495951 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-9cf75c72-0549-4dbe-9c6c-e5fb8cde245e tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:28.633265 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-9cf75c72-0549-4dbe-9c6c-e5fb8cde245e tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:28.643326 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-9cf75c72-0549-4dbe-9c6c-e5fb8cde245e tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:28.645226 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-9cf75c72-0549-4dbe-9c6c-e5fb8cde245e tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:28.646450 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-9cf75c72-0549-4dbe-9c6c-e5fb8cde245e tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1736 microversion: 2.20 time: 0.163661 Jun 07 09:32:28.647213 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 281/563] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:32:28 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 09:32:29.664864 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-eeaf4887-201d-4b9a-b07f-b371130b91ff tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:32:29.665478 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-eeaf4887-201d-4b9a-b07f-b371130b91ff tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:32:29.672154 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-eeaf4887-201d-4b9a-b07f-b371130b91ff tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:29.672630 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-eeaf4887-201d-4b9a-b07f-b371130b91ff tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:29.673958 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-eeaf4887-201d-4b9a-b07f-b371130b91ff tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:29.674423 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-eeaf4887-201d-4b9a-b07f-b371130b91ff tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:29.805779 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-eeaf4887-201d-4b9a-b07f-b371130b91ff tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:29.814519 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-eeaf4887-201d-4b9a-b07f-b371130b91ff tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:29.816808 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-eeaf4887-201d-4b9a-b07f-b371130b91ff tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:29.817963 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-eeaf4887-201d-4b9a-b07f-b371130b91ff tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1736 microversion: 2.20 time: 0.157163 Jun 07 09:32:29.818504 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 283/564] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:32:29 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:32:30.836461 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-bc530eb0-1730-4d5e-9c86-7fcba07dbb82 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:32:30.837525 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-bc530eb0-1730-4d5e-9c86-7fcba07dbb82 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:32:30.844199 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-bc530eb0-1730-4d5e-9c86-7fcba07dbb82 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:30.844829 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-bc530eb0-1730-4d5e-9c86-7fcba07dbb82 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:30.845992 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-bc530eb0-1730-4d5e-9c86-7fcba07dbb82 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:30.846240 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-bc530eb0-1730-4d5e-9c86-7fcba07dbb82 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:30.976466 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-bc530eb0-1730-4d5e-9c86-7fcba07dbb82 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:30.984917 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-bc530eb0-1730-4d5e-9c86-7fcba07dbb82 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:30.986423 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-bc530eb0-1730-4d5e-9c86-7fcba07dbb82 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:30.987650 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-bc530eb0-1730-4d5e-9c86-7fcba07dbb82 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1718 microversion: 2.20 time: 0.155692 Jun 07 09:32:30.988203 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 282/565] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:32:30 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1718 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:32:32.013507 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-67176411-6c60-41cf-8b86-1fc8e121f8e2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:32:32.014257 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-67176411-6c60-41cf-8b86-1fc8e121f8e2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:32:32.022510 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-67176411-6c60-41cf-8b86-1fc8e121f8e2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:32.022965 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-67176411-6c60-41cf-8b86-1fc8e121f8e2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:32.023745 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-67176411-6c60-41cf-8b86-1fc8e121f8e2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:32.024266 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-67176411-6c60-41cf-8b86-1fc8e121f8e2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:32.158710 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-67176411-6c60-41cf-8b86-1fc8e121f8e2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:32.166940 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-67176411-6c60-41cf-8b86-1fc8e121f8e2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:32.168898 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-67176411-6c60-41cf-8b86-1fc8e121f8e2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:32.170166 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-67176411-6c60-41cf-8b86-1fc8e121f8e2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1718 microversion: 2.20 time: 0.160620 Jun 07 09:32:32.170981 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 284/566] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:32:32 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1718 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:32:33.188911 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-2c3dde95-02a8-42e2-bb50-3085090c6c88 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:32:33.189581 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-2c3dde95-02a8-42e2-bb50-3085090c6c88 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:32:33.197127 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-2c3dde95-02a8-42e2-bb50-3085090c6c88 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:33.197584 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-2c3dde95-02a8-42e2-bb50-3085090c6c88 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:33.198441 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-2c3dde95-02a8-42e2-bb50-3085090c6c88 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:33.199063 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-2c3dde95-02a8-42e2-bb50-3085090c6c88 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:33.334056 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-2c3dde95-02a8-42e2-bb50-3085090c6c88 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:33.341895 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-2c3dde95-02a8-42e2-bb50-3085090c6c88 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:33.343395 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-2c3dde95-02a8-42e2-bb50-3085090c6c88 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:33.344534 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-2c3dde95-02a8-42e2-bb50-3085090c6c88 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1721 microversion: 2.20 time: 0.159863 Jun 07 09:32:33.345106 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 283/567] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:32:33 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:32:33.362746 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-4f282949-1e7a-4ae0-82d0-4aba926d7b53 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "62a1333a-f803-4adf-9361-d1ac3f265f3f"}} {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:32:33.364106 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-4f282949-1e7a-4ae0-82d0-4aba926d7b53 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:32:33.371214 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-4f282949-1e7a-4ae0-82d0-4aba926d7b53 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:33.371668 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-4f282949-1e7a-4ae0-82d0-4aba926d7b53 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:33.372449 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-4f282949-1e7a-4ae0-82d0-4aba926d7b53 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:33.372916 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-4f282949-1e7a-4ae0-82d0-4aba926d7b53 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:33.376680 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writing DB stats nova_cell1:SELECT=100 {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:32:34.289858 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-4f282949-1e7a-4ae0-82d0-4aba926d7b53 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "POST /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.930851 Jun 07 09:32:34.290405 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 285/568] 10.222.0.57 () {62 vars in 1363 bytes} [Tue Jun 7 09:32:33 2022] POST /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2/os-volume_attachments => generated 188 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 09:32:34.405836 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-c1ecf44d-6de3-4e59-90f8-46389b748790 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:32:34.406414 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-c1ecf44d-6de3-4e59-90f8-46389b748790 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:32:34.413228 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-c1ecf44d-6de3-4e59-90f8-46389b748790 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:34.413700 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-c1ecf44d-6de3-4e59-90f8-46389b748790 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:34.414454 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-c1ecf44d-6de3-4e59-90f8-46389b748790 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:34.414974 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-c1ecf44d-6de3-4e59-90f8-46389b748790 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:34.513444 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [req-aa12b280-b0e5-44e2-8c82-484df49d9b3e req-28836cd9-b9f5-40bd-9802-4e437fbe5eaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "102039c7-8224-43f7-9fb8-90b82968cfa2", "name": "network-vif-unplugged", "status": "completed", "tag": "647bfcc4-5bf0-429c-803e-b72ea4c0fa25"}]} {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:32:34.522687 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [req-aa12b280-b0e5-44e2-8c82-484df49d9b3e req-28836cd9-b9f5-40bd-9802-4e437fbe5eaa service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:34.523137 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [req-aa12b280-b0e5-44e2-8c82-484df49d9b3e req-28836cd9-b9f5-40bd-9802-4e437fbe5eaa service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:34.533796 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.compute.server_external_events [req-aa12b280-b0e5-44e2-8c82-484df49d9b3e req-28836cd9-b9f5-40bd-9802-4e437fbe5eaa service nova] Unable to find a host for instance 102039c7-8224-43f7-9fb8-90b82968cfa2. Dropping event network-vif-unplugged {{(pid=118740) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 07 09:32:34.534686 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [req-aa12b280-b0e5-44e2-8c82-484df49d9b3e req-28836cd9-b9f5-40bd-9802-4e437fbe5eaa service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.025161 Jun 07 09:32:34.535797 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 286/569] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Jun 7 09:32:34 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 27 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jun 07 09:32:34.690658 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-c1ecf44d-6de3-4e59-90f8-46389b748790 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "POST /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2/action" status: 202 len: 0 microversion: 2.20 time: 0.287963 Jun 07 09:32:34.691804 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 284/570] 10.222.0.57 () {62 vars in 1318 bytes} [Tue Jun 7 09:32:34 2022] POST /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2/action => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 07 09:32:34.699683 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-a368751c-e762-4482-b37e-8ab74eed3d64 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:32:34.700293 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-a368751c-e762-4482-b37e-8ab74eed3d64 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:32:34.706267 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-a368751c-e762-4482-b37e-8ab74eed3d64 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:34.706711 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-a368751c-e762-4482-b37e-8ab74eed3d64 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:34.707492 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-a368751c-e762-4482-b37e-8ab74eed3d64 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:34.707929 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-a368751c-e762-4482-b37e-8ab74eed3d64 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:34.847245 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-a368751c-e762-4482-b37e-8ab74eed3d64 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:34.856202 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-a368751c-e762-4482-b37e-8ab74eed3d64 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:34.858009 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-a368751c-e762-4482-b37e-8ab74eed3d64 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:34.859164 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-a368751c-e762-4482-b37e-8ab74eed3d64 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1747 microversion: 2.20 time: 0.163395 Jun 07 09:32:34.870608 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 287/571] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:32:34 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1747 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:32:35.877248 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-1abc5c8e-6d9b-40a5-9a38-43ea914d512a tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:32:35.878564 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-1abc5c8e-6d9b-40a5-9a38-43ea914d512a tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:32:35.885141 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-1abc5c8e-6d9b-40a5-9a38-43ea914d512a tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:35.885837 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-1abc5c8e-6d9b-40a5-9a38-43ea914d512a tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:35.886873 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-1abc5c8e-6d9b-40a5-9a38-43ea914d512a tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:35.887317 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-1abc5c8e-6d9b-40a5-9a38-43ea914d512a tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:36.023749 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-1abc5c8e-6d9b-40a5-9a38-43ea914d512a tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:36.032174 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-1abc5c8e-6d9b-40a5-9a38-43ea914d512a tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:36.033752 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-1abc5c8e-6d9b-40a5-9a38-43ea914d512a tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:36.035088 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-1abc5c8e-6d9b-40a5-9a38-43ea914d512a tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1747 microversion: 2.20 time: 0.161982 Jun 07 09:32:36.036225 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 285/572] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:32:35 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1747 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:32:37.054730 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-fe009f87-3230-43e5-b3fd-d69bb03bba38 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:32:37.055325 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-fe009f87-3230-43e5-b3fd-d69bb03bba38 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:32:37.061518 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-fe009f87-3230-43e5-b3fd-d69bb03bba38 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:37.061945 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-fe009f87-3230-43e5-b3fd-d69bb03bba38 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:37.062884 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-fe009f87-3230-43e5-b3fd-d69bb03bba38 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:37.063472 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-fe009f87-3230-43e5-b3fd-d69bb03bba38 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:37.199251 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-fe009f87-3230-43e5-b3fd-d69bb03bba38 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:37.209036 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-fe009f87-3230-43e5-b3fd-d69bb03bba38 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:37.210800 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-fe009f87-3230-43e5-b3fd-d69bb03bba38 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:37.211947 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-fe009f87-3230-43e5-b3fd-d69bb03bba38 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1749 microversion: 2.20 time: 0.161736 Jun 07 09:32:37.212495 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 288/573] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:32:37 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1749 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:32:38.231550 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-b4d26821-a1cb-4007-b4c5-4ac2d826c148 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:32:38.232143 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-b4d26821-a1cb-4007-b4c5-4ac2d826c148 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:32:38.239500 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b4d26821-a1cb-4007-b4c5-4ac2d826c148 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:38.239956 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b4d26821-a1cb-4007-b4c5-4ac2d826c148 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:38.240752 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b4d26821-a1cb-4007-b4c5-4ac2d826c148 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:38.241180 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b4d26821-a1cb-4007-b4c5-4ac2d826c148 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:38.373449 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-b4d26821-a1cb-4007-b4c5-4ac2d826c148 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:38.381613 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-b4d26821-a1cb-4007-b4c5-4ac2d826c148 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:38.383098 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-b4d26821-a1cb-4007-b4c5-4ac2d826c148 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:38.384228 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-b4d26821-a1cb-4007-b4c5-4ac2d826c148 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1805 microversion: 2.20 time: 0.156935 Jun 07 09:32:38.384812 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 286/574] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:32:38 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1805 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:32:39.401301 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-42ae5b61-64dc-44c4-bdf0-2314f14b52a5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:32:39.402106 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-42ae5b61-64dc-44c4-bdf0-2314f14b52a5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:32:39.408714 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-42ae5b61-64dc-44c4-bdf0-2314f14b52a5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:39.409061 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-42ae5b61-64dc-44c4-bdf0-2314f14b52a5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:39.409829 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-42ae5b61-64dc-44c4-bdf0-2314f14b52a5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:39.410857 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-42ae5b61-64dc-44c4-bdf0-2314f14b52a5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:39.543072 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-42ae5b61-64dc-44c4-bdf0-2314f14b52a5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:39.551520 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-42ae5b61-64dc-44c4-bdf0-2314f14b52a5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:39.553069 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-42ae5b61-64dc-44c4-bdf0-2314f14b52a5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:39.554220 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-42ae5b61-64dc-44c4-bdf0-2314f14b52a5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1805 microversion: 2.20 time: 0.156736 Jun 07 09:32:39.554770 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 289/575] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:32:39 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1805 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:32:40.574057 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-1fd80d54-5e5d-4450-8faa-eefe8b34738c tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:32:40.574681 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-1fd80d54-5e5d-4450-8faa-eefe8b34738c tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:32:40.580882 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-1fd80d54-5e5d-4450-8faa-eefe8b34738c tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:40.581328 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-1fd80d54-5e5d-4450-8faa-eefe8b34738c tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:40.582743 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-1fd80d54-5e5d-4450-8faa-eefe8b34738c tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:40.583180 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-1fd80d54-5e5d-4450-8faa-eefe8b34738c tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:40.716798 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-1fd80d54-5e5d-4450-8faa-eefe8b34738c tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:40.725927 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-1fd80d54-5e5d-4450-8faa-eefe8b34738c tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:40.727428 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-1fd80d54-5e5d-4450-8faa-eefe8b34738c tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:40.728604 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-1fd80d54-5e5d-4450-8faa-eefe8b34738c tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1805 microversion: 2.20 time: 0.159007 Jun 07 09:32:40.729191 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 287/576] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:32:40 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1805 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:32:41.747409 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-b905846e-2c73-42a5-b99a-3a2fa669350f tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:32:41.748043 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-b905846e-2c73-42a5-b99a-3a2fa669350f tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:32:41.755997 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b905846e-2c73-42a5-b99a-3a2fa669350f tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:41.756566 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b905846e-2c73-42a5-b99a-3a2fa669350f tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:41.757360 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b905846e-2c73-42a5-b99a-3a2fa669350f tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:41.757803 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b905846e-2c73-42a5-b99a-3a2fa669350f tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:41.892991 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-b905846e-2c73-42a5-b99a-3a2fa669350f tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:41.901597 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-b905846e-2c73-42a5-b99a-3a2fa669350f tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:41.903102 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-b905846e-2c73-42a5-b99a-3a2fa669350f tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:41.904254 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-b905846e-2c73-42a5-b99a-3a2fa669350f tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1805 microversion: 2.20 time: 0.160870 Jun 07 09:32:41.910775 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 290/577] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:32:41 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1805 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:32:42.923214 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-d1c88d05-3c3f-4cf3-9635-ee4b7804331a tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:32:42.923860 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-d1c88d05-3c3f-4cf3-9635-ee4b7804331a tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:32:42.927321 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writing DB stats nova_api:SELECT=40 {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:32:42.933256 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-d1c88d05-3c3f-4cf3-9635-ee4b7804331a tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:42.933708 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-d1c88d05-3c3f-4cf3-9635-ee4b7804331a tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:42.937874 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-d1c88d05-3c3f-4cf3-9635-ee4b7804331a tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:42.937874 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-d1c88d05-3c3f-4cf3-9635-ee4b7804331a tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:43.087326 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-d1c88d05-3c3f-4cf3-9635-ee4b7804331a tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:43.096130 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-d1c88d05-3c3f-4cf3-9635-ee4b7804331a tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:43.097683 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-d1c88d05-3c3f-4cf3-9635-ee4b7804331a tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:43.098875 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-d1c88d05-3c3f-4cf3-9635-ee4b7804331a tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1805 microversion: 2.20 time: 0.179611 Jun 07 09:32:43.099485 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 288/578] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:32:42 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1805 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:32:44.119788 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-b753cd95-7a88-48c8-bfac-6ed869467d92 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:32:44.120344 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-b753cd95-7a88-48c8-bfac-6ed869467d92 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:32:44.127083 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b753cd95-7a88-48c8-bfac-6ed869467d92 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:44.127538 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b753cd95-7a88-48c8-bfac-6ed869467d92 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:44.128307 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b753cd95-7a88-48c8-bfac-6ed869467d92 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:44.129485 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b753cd95-7a88-48c8-bfac-6ed869467d92 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:44.267219 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-b753cd95-7a88-48c8-bfac-6ed869467d92 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:44.276527 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-b753cd95-7a88-48c8-bfac-6ed869467d92 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:44.278078 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-b753cd95-7a88-48c8-bfac-6ed869467d92 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:44.279229 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-b753cd95-7a88-48c8-bfac-6ed869467d92 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1805 microversion: 2.20 time: 0.164109 Jun 07 09:32:44.280061 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 291/579] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:32:44 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1805 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 09:32:45.297457 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-69c9b5d1-736e-49be-9472-3074198189ed tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:32:45.298038 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-69c9b5d1-736e-49be-9472-3074198189ed tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:32:45.304285 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-69c9b5d1-736e-49be-9472-3074198189ed tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:45.304778 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-69c9b5d1-736e-49be-9472-3074198189ed tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:45.305535 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-69c9b5d1-736e-49be-9472-3074198189ed tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:45.305969 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-69c9b5d1-736e-49be-9472-3074198189ed tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:45.437036 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-69c9b5d1-736e-49be-9472-3074198189ed tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:45.445534 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-69c9b5d1-736e-49be-9472-3074198189ed tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:45.447081 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-69c9b5d1-736e-49be-9472-3074198189ed tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:45.448196 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-69c9b5d1-736e-49be-9472-3074198189ed tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1805 microversion: 2.20 time: 0.154831 Jun 07 09:32:45.448783 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 289/580] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:32:45 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1805 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:32:46.466992 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-9a1806da-a882-4d61-9abe-ece735f45e53 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:32:46.467610 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-9a1806da-a882-4d61-9abe-ece735f45e53 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:32:46.470052 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writing DB stats nova_api:SELECT=34 {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:32:46.474953 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-9a1806da-a882-4d61-9abe-ece735f45e53 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:46.475458 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-9a1806da-a882-4d61-9abe-ece735f45e53 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:46.476277 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-9a1806da-a882-4d61-9abe-ece735f45e53 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:46.476815 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-9a1806da-a882-4d61-9abe-ece735f45e53 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:46.615979 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-9a1806da-a882-4d61-9abe-ece735f45e53 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:46.624237 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-9a1806da-a882-4d61-9abe-ece735f45e53 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:46.625778 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-9a1806da-a882-4d61-9abe-ece735f45e53 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:46.626924 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-9a1806da-a882-4d61-9abe-ece735f45e53 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1805 microversion: 2.20 time: 0.163992 Jun 07 09:32:46.627476 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 292/581] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:32:46 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1805 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:32:47.645429 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-debd6da4-0120-4de6-a7dc-064627943a27 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:32:47.646751 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-debd6da4-0120-4de6-a7dc-064627943a27 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:32:47.653195 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-debd6da4-0120-4de6-a7dc-064627943a27 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:47.653751 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-debd6da4-0120-4de6-a7dc-064627943a27 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:47.654792 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-debd6da4-0120-4de6-a7dc-064627943a27 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:47.655452 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-debd6da4-0120-4de6-a7dc-064627943a27 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:47.658487 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:32:47.799938 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-debd6da4-0120-4de6-a7dc-064627943a27 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:47.809974 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-debd6da4-0120-4de6-a7dc-064627943a27 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:47.811497 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-debd6da4-0120-4de6-a7dc-064627943a27 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:47.812733 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-debd6da4-0120-4de6-a7dc-064627943a27 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1805 microversion: 2.20 time: 0.171216 Jun 07 09:32:47.813692 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 290/582] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:32:47 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1805 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:32:48.833952 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-1293258b-bc0c-4ba0-b940-d49795058c5d tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:32:48.834805 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-1293258b-bc0c-4ba0-b940-d49795058c5d tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:32:48.842865 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-1293258b-bc0c-4ba0-b940-d49795058c5d tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:48.843376 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-1293258b-bc0c-4ba0-b940-d49795058c5d tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:48.844293 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-1293258b-bc0c-4ba0-b940-d49795058c5d tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:48.844885 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-1293258b-bc0c-4ba0-b940-d49795058c5d tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:49.003044 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-1293258b-bc0c-4ba0-b940-d49795058c5d tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:49.018407 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-1293258b-bc0c-4ba0-b940-d49795058c5d tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:49.018407 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-1293258b-bc0c-4ba0-b940-d49795058c5d tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:49.018407 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-1293258b-bc0c-4ba0-b940-d49795058c5d tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1805 microversion: 2.20 time: 0.189935 Jun 07 09:32:49.018958 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 293/583] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:32:48 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1805 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:32:50.037861 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-be96c813-ae7d-4f51-aac3-a99ecc6177e3 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:32:50.039062 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-be96c813-ae7d-4f51-aac3-a99ecc6177e3 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:32:50.046175 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-be96c813-ae7d-4f51-aac3-a99ecc6177e3 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:50.046619 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-be96c813-ae7d-4f51-aac3-a99ecc6177e3 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:50.047389 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-be96c813-ae7d-4f51-aac3-a99ecc6177e3 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:50.047827 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-be96c813-ae7d-4f51-aac3-a99ecc6177e3 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:50.186880 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-be96c813-ae7d-4f51-aac3-a99ecc6177e3 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:50.196146 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-be96c813-ae7d-4f51-aac3-a99ecc6177e3 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:50.198190 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-be96c813-ae7d-4f51-aac3-a99ecc6177e3 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:50.199756 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-be96c813-ae7d-4f51-aac3-a99ecc6177e3 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1805 microversion: 2.20 time: 0.166876 Jun 07 09:32:50.200339 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 291/584] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:32:50 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1805 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:32:51.217900 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-bfa72d8d-5f62-468b-9ffd-586bf96accb8 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:32:51.219146 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-bfa72d8d-5f62-468b-9ffd-586bf96accb8 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:32:51.225735 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-bfa72d8d-5f62-468b-9ffd-586bf96accb8 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:51.226191 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-bfa72d8d-5f62-468b-9ffd-586bf96accb8 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:51.226963 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-bfa72d8d-5f62-468b-9ffd-586bf96accb8 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:51.227482 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-bfa72d8d-5f62-468b-9ffd-586bf96accb8 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:51.363614 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-bfa72d8d-5f62-468b-9ffd-586bf96accb8 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:51.372914 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-bfa72d8d-5f62-468b-9ffd-586bf96accb8 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:51.374411 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-bfa72d8d-5f62-468b-9ffd-586bf96accb8 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:51.375576 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-bfa72d8d-5f62-468b-9ffd-586bf96accb8 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1805 microversion: 2.20 time: 0.161548 Jun 07 09:32:51.376257 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 294/585] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:32:51 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1805 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:32:52.394049 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-8d66cc39-5bc2-4d80-9b72-06269701f1fd tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:32:52.395210 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-8d66cc39-5bc2-4d80-9b72-06269701f1fd tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:32:52.401240 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-8d66cc39-5bc2-4d80-9b72-06269701f1fd tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:52.401688 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-8d66cc39-5bc2-4d80-9b72-06269701f1fd tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:52.402467 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-8d66cc39-5bc2-4d80-9b72-06269701f1fd tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:52.402899 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-8d66cc39-5bc2-4d80-9b72-06269701f1fd tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:52.533548 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-8d66cc39-5bc2-4d80-9b72-06269701f1fd tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:52.541968 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-8d66cc39-5bc2-4d80-9b72-06269701f1fd tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:52.543462 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-8d66cc39-5bc2-4d80-9b72-06269701f1fd tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:52.544614 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-8d66cc39-5bc2-4d80-9b72-06269701f1fd tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1805 microversion: 2.20 time: 0.154526 Jun 07 09:32:52.545178 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 292/586] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:32:52 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1805 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:32:53.567121 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-a6b09820-0bce-4f47-9d5f-724561a0c66b tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:32:53.567917 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-a6b09820-0bce-4f47-9d5f-724561a0c66b tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:32:53.574745 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-a6b09820-0bce-4f47-9d5f-724561a0c66b tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:53.575199 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-a6b09820-0bce-4f47-9d5f-724561a0c66b tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:53.575957 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-a6b09820-0bce-4f47-9d5f-724561a0c66b tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:53.576399 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-a6b09820-0bce-4f47-9d5f-724561a0c66b tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:53.712069 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-a6b09820-0bce-4f47-9d5f-724561a0c66b tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:53.720492 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-a6b09820-0bce-4f47-9d5f-724561a0c66b tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:53.721982 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-a6b09820-0bce-4f47-9d5f-724561a0c66b tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:53.723133 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-a6b09820-0bce-4f47-9d5f-724561a0c66b tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1805 microversion: 2.20 time: 0.161064 Jun 07 09:32:53.723685 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 295/587] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:32:53 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1805 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:32:54.742006 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-b9cfd9da-e923-41b4-968a-7560d35bae86 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:32:54.742614 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-b9cfd9da-e923-41b4-968a-7560d35bae86 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:32:54.748759 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b9cfd9da-e923-41b4-968a-7560d35bae86 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:54.752094 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b9cfd9da-e923-41b4-968a-7560d35bae86 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:54.752094 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b9cfd9da-e923-41b4-968a-7560d35bae86 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:54.752094 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b9cfd9da-e923-41b4-968a-7560d35bae86 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:54.879552 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-b9cfd9da-e923-41b4-968a-7560d35bae86 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:54.888234 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-b9cfd9da-e923-41b4-968a-7560d35bae86 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:54.889768 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-b9cfd9da-e923-41b4-968a-7560d35bae86 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:54.890916 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-b9cfd9da-e923-41b4-968a-7560d35bae86 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1805 microversion: 2.20 time: 0.153348 Jun 07 09:32:54.891492 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 293/588] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:32:54 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1805 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:32:55.908943 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-31436872-5ca2-47ca-a2e7-6f941e529f2a tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:32:55.909479 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-31436872-5ca2-47ca-a2e7-6f941e529f2a tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:32:55.916518 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-31436872-5ca2-47ca-a2e7-6f941e529f2a tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:55.916992 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-31436872-5ca2-47ca-a2e7-6f941e529f2a tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:55.917750 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-31436872-5ca2-47ca-a2e7-6f941e529f2a tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:55.918182 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-31436872-5ca2-47ca-a2e7-6f941e529f2a tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:56.044094 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-31436872-5ca2-47ca-a2e7-6f941e529f2a tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:56.052964 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-31436872-5ca2-47ca-a2e7-6f941e529f2a tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:56.054467 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-31436872-5ca2-47ca-a2e7-6f941e529f2a tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:56.055644 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-31436872-5ca2-47ca-a2e7-6f941e529f2a tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1805 microversion: 2.20 time: 0.150646 Jun 07 09:32:56.056192 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 296/589] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:32:55 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1805 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:32:57.072964 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-7fffbe42-84bf-4380-b10a-cea52180ba77 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:32:57.073569 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-7fffbe42-84bf-4380-b10a-cea52180ba77 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:32:57.079524 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-7fffbe42-84bf-4380-b10a-cea52180ba77 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:57.079971 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-7fffbe42-84bf-4380-b10a-cea52180ba77 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:57.080764 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-7fffbe42-84bf-4380-b10a-cea52180ba77 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:57.081198 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-7fffbe42-84bf-4380-b10a-cea52180ba77 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:57.204106 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-7fffbe42-84bf-4380-b10a-cea52180ba77 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:57.212958 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-7fffbe42-84bf-4380-b10a-cea52180ba77 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:57.214455 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-7fffbe42-84bf-4380-b10a-cea52180ba77 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:57.215592 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-7fffbe42-84bf-4380-b10a-cea52180ba77 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1805 microversion: 2.20 time: 0.146544 Jun 07 09:32:57.216150 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 294/590] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:32:57 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1805 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:32:58.234403 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-19272114-6867-48d5-b5dc-4fa889d34acc tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:32:58.235038 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-19272114-6867-48d5-b5dc-4fa889d34acc tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:32:58.242127 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-19272114-6867-48d5-b5dc-4fa889d34acc tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:58.242572 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-19272114-6867-48d5-b5dc-4fa889d34acc tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:58.243328 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-19272114-6867-48d5-b5dc-4fa889d34acc tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:58.243763 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-19272114-6867-48d5-b5dc-4fa889d34acc tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:58.374152 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-19272114-6867-48d5-b5dc-4fa889d34acc tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:58.382693 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-19272114-6867-48d5-b5dc-4fa889d34acc tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:58.384279 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-19272114-6867-48d5-b5dc-4fa889d34acc tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:58.385464 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-19272114-6867-48d5-b5dc-4fa889d34acc tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1805 microversion: 2.20 time: 0.155176 Jun 07 09:32:58.386019 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 297/591] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:32:58 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1805 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:32:59.403508 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-b58c8eab-a3c0-4c7c-8c9e-c8155062ba68 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:32:59.404145 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-b58c8eab-a3c0-4c7c-8c9e-c8155062ba68 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:32:59.410200 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b58c8eab-a3c0-4c7c-8c9e-c8155062ba68 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:59.410647 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b58c8eab-a3c0-4c7c-8c9e-c8155062ba68 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:59.411895 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b58c8eab-a3c0-4c7c-8c9e-c8155062ba68 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:32:59.412329 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b58c8eab-a3c0-4c7c-8c9e-c8155062ba68 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:32:59.541708 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-b58c8eab-a3c0-4c7c-8c9e-c8155062ba68 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:59.550090 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-b58c8eab-a3c0-4c7c-8c9e-c8155062ba68 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:59.551585 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-b58c8eab-a3c0-4c7c-8c9e-c8155062ba68 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:32:59.553249 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-b58c8eab-a3c0-4c7c-8c9e-c8155062ba68 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1805 microversion: 2.20 time: 0.153630 Jun 07 09:32:59.553800 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 295/592] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:32:59 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1805 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:33:00.571974 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-bb867b2d-ffe5-4f91-bd41-7fd103f80238 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:33:00.572597 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-bb867b2d-ffe5-4f91-bd41-7fd103f80238 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:33:00.579020 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-bb867b2d-ffe5-4f91-bd41-7fd103f80238 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:00.579415 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-bb867b2d-ffe5-4f91-bd41-7fd103f80238 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:00.580218 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-bb867b2d-ffe5-4f91-bd41-7fd103f80238 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:00.580683 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-bb867b2d-ffe5-4f91-bd41-7fd103f80238 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:00.707765 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-bb867b2d-ffe5-4f91-bd41-7fd103f80238 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:33:00.716128 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-bb867b2d-ffe5-4f91-bd41-7fd103f80238 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:33:00.717667 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-bb867b2d-ffe5-4f91-bd41-7fd103f80238 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:33:00.718848 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-bb867b2d-ffe5-4f91-bd41-7fd103f80238 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1805 microversion: 2.20 time: 0.151471 Jun 07 09:33:00.719408 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 298/593] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:33:00 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1805 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:33:01.738062 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-05152a71-7a51-4acc-abb4-56240fc20f99 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:33:01.738597 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-05152a71-7a51-4acc-abb4-56240fc20f99 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:33:01.744671 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-05152a71-7a51-4acc-abb4-56240fc20f99 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:01.745122 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-05152a71-7a51-4acc-abb4-56240fc20f99 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:01.745878 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-05152a71-7a51-4acc-abb4-56240fc20f99 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:01.746322 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-05152a71-7a51-4acc-abb4-56240fc20f99 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:01.871408 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-05152a71-7a51-4acc-abb4-56240fc20f99 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:33:01.879724 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-05152a71-7a51-4acc-abb4-56240fc20f99 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:33:01.881251 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-05152a71-7a51-4acc-abb4-56240fc20f99 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:33:01.882398 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-05152a71-7a51-4acc-abb4-56240fc20f99 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1805 microversion: 2.20 time: 0.148290 Jun 07 09:33:01.882959 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 296/594] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:33:01 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1805 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:33:02.901398 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-768541cf-fc07-4f01-88e5-e35a1f05cc34 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:33:02.901953 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-768541cf-fc07-4f01-88e5-e35a1f05cc34 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:33:02.908374 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-768541cf-fc07-4f01-88e5-e35a1f05cc34 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:02.908860 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-768541cf-fc07-4f01-88e5-e35a1f05cc34 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:02.909622 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-768541cf-fc07-4f01-88e5-e35a1f05cc34 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:02.910056 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-768541cf-fc07-4f01-88e5-e35a1f05cc34 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:03.037280 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-768541cf-fc07-4f01-88e5-e35a1f05cc34 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:33:03.039486 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:33:03.046349 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-768541cf-fc07-4f01-88e5-e35a1f05cc34 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:33:03.053534 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-768541cf-fc07-4f01-88e5-e35a1f05cc34 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:33:03.053534 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-768541cf-fc07-4f01-88e5-e35a1f05cc34 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1805 microversion: 2.20 time: 0.151544 Jun 07 09:33:03.053534 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 299/595] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:33:02 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1805 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 09:33:04.067103 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-30821866-adae-48c1-b8c6-396a65c41939 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:33:04.068324 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-30821866-adae-48c1-b8c6-396a65c41939 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:33:04.074400 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-30821866-adae-48c1-b8c6-396a65c41939 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:04.074842 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-30821866-adae-48c1-b8c6-396a65c41939 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:04.075594 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-30821866-adae-48c1-b8c6-396a65c41939 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:04.076023 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-30821866-adae-48c1-b8c6-396a65c41939 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:04.202360 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-30821866-adae-48c1-b8c6-396a65c41939 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:33:04.210744 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-30821866-adae-48c1-b8c6-396a65c41939 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:33:04.212236 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-30821866-adae-48c1-b8c6-396a65c41939 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:33:04.213418 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-30821866-adae-48c1-b8c6-396a65c41939 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1805 microversion: 2.20 time: 0.150207 Jun 07 09:33:04.213979 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 297/596] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:33:04 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1805 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:33:05.232120 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-27f8bfd7-39c6-499f-ae20-ef680cb93fdf tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:33:05.232855 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-27f8bfd7-39c6-499f-ae20-ef680cb93fdf tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:33:05.239917 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-27f8bfd7-39c6-499f-ae20-ef680cb93fdf tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:05.240533 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-27f8bfd7-39c6-499f-ae20-ef680cb93fdf tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:05.241886 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-27f8bfd7-39c6-499f-ae20-ef680cb93fdf tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:05.242504 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-27f8bfd7-39c6-499f-ae20-ef680cb93fdf tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:05.371347 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-27f8bfd7-39c6-499f-ae20-ef680cb93fdf tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:33:05.379553 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-27f8bfd7-39c6-499f-ae20-ef680cb93fdf tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:33:05.381690 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-27f8bfd7-39c6-499f-ae20-ef680cb93fdf tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:33:05.382842 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-27f8bfd7-39c6-499f-ae20-ef680cb93fdf tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1805 microversion: 2.20 time: 0.155570 Jun 07 09:33:05.383513 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 300/597] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:33:05 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1805 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:33:06.401182 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-6361e114-d474-4026-93d6-5084016a0cd0 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:33:06.401788 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-6361e114-d474-4026-93d6-5084016a0cd0 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:33:06.407797 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-6361e114-d474-4026-93d6-5084016a0cd0 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:06.408240 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-6361e114-d474-4026-93d6-5084016a0cd0 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:06.409017 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-6361e114-d474-4026-93d6-5084016a0cd0 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:06.409451 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-6361e114-d474-4026-93d6-5084016a0cd0 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:06.533913 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-6361e114-d474-4026-93d6-5084016a0cd0 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:33:06.542371 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-6361e114-d474-4026-93d6-5084016a0cd0 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:33:06.543805 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-6361e114-d474-4026-93d6-5084016a0cd0 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:33:06.544982 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-6361e114-d474-4026-93d6-5084016a0cd0 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1805 microversion: 2.20 time: 0.147653 Jun 07 09:33:06.549876 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 298/598] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:33:06 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1805 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:33:07.564083 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-539be287-6773-4d77-b97f-36cf04c0bd2c tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:33:07.564654 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-539be287-6773-4d77-b97f-36cf04c0bd2c tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:33:07.571190 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-539be287-6773-4d77-b97f-36cf04c0bd2c tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:07.571672 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-539be287-6773-4d77-b97f-36cf04c0bd2c tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:07.572441 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-539be287-6773-4d77-b97f-36cf04c0bd2c tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:07.572912 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-539be287-6773-4d77-b97f-36cf04c0bd2c tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:07.699231 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-539be287-6773-4d77-b97f-36cf04c0bd2c tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:33:07.707495 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-539be287-6773-4d77-b97f-36cf04c0bd2c tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:33:07.709514 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-539be287-6773-4d77-b97f-36cf04c0bd2c tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:33:07.710656 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-539be287-6773-4d77-b97f-36cf04c0bd2c tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1805 microversion: 2.20 time: 0.151046 Jun 07 09:33:07.711203 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 301/599] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:33:07 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1805 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:33:08.728745 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-6711cb62-f26c-4681-a24e-ae048bac3f17 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:33:08.729230 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-6711cb62-f26c-4681-a24e-ae048bac3f17 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:33:08.736430 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-6711cb62-f26c-4681-a24e-ae048bac3f17 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:08.736905 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-6711cb62-f26c-4681-a24e-ae048bac3f17 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:08.737663 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-6711cb62-f26c-4681-a24e-ae048bac3f17 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:08.738089 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-6711cb62-f26c-4681-a24e-ae048bac3f17 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:08.869759 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-6711cb62-f26c-4681-a24e-ae048bac3f17 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:33:08.878098 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-6711cb62-f26c-4681-a24e-ae048bac3f17 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:33:08.879658 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-6711cb62-f26c-4681-a24e-ae048bac3f17 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:33:08.881343 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-6711cb62-f26c-4681-a24e-ae048bac3f17 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1805 microversion: 2.20 time: 0.156149 Jun 07 09:33:08.881900 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 299/600] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:33:08 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1805 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:33:09.899181 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-b7396746-d1b9-4ffe-8228-74499dbd8f19 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:33:09.899820 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-b7396746-d1b9-4ffe-8228-74499dbd8f19 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:33:09.906354 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b7396746-d1b9-4ffe-8228-74499dbd8f19 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:09.906812 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b7396746-d1b9-4ffe-8228-74499dbd8f19 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:09.907581 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b7396746-d1b9-4ffe-8228-74499dbd8f19 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:09.908015 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b7396746-d1b9-4ffe-8228-74499dbd8f19 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:10.040480 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-b7396746-d1b9-4ffe-8228-74499dbd8f19 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:33:10.048875 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-b7396746-d1b9-4ffe-8228-74499dbd8f19 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:33:10.050380 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-b7396746-d1b9-4ffe-8228-74499dbd8f19 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:33:10.051526 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-b7396746-d1b9-4ffe-8228-74499dbd8f19 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1805 microversion: 2.20 time: 0.156321 Jun 07 09:33:10.052089 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 302/601] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:33:09 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1805 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:33:11.070745 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-8ca08810-d1e8-4155-9029-371ec1e319c5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:33:11.071355 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-8ca08810-d1e8-4155-9029-371ec1e319c5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:33:11.077336 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-8ca08810-d1e8-4155-9029-371ec1e319c5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:11.077780 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-8ca08810-d1e8-4155-9029-371ec1e319c5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:11.078527 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-8ca08810-d1e8-4155-9029-371ec1e319c5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:11.078957 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-8ca08810-d1e8-4155-9029-371ec1e319c5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:11.206333 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-8ca08810-d1e8-4155-9029-371ec1e319c5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:33:11.214724 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-8ca08810-d1e8-4155-9029-371ec1e319c5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:33:11.216211 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-8ca08810-d1e8-4155-9029-371ec1e319c5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:33:11.217370 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-8ca08810-d1e8-4155-9029-371ec1e319c5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1805 microversion: 2.20 time: 0.151213 Jun 07 09:33:11.217916 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 300/602] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:33:11 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1805 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 09:33:12.236661 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-f04e2887-8477-4be8-bbcc-bfb3e9d3fb97 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:33:12.237272 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-f04e2887-8477-4be8-bbcc-bfb3e9d3fb97 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:33:12.243835 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-f04e2887-8477-4be8-bbcc-bfb3e9d3fb97 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:12.244280 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-f04e2887-8477-4be8-bbcc-bfb3e9d3fb97 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:12.245066 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-f04e2887-8477-4be8-bbcc-bfb3e9d3fb97 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:12.245499 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-f04e2887-8477-4be8-bbcc-bfb3e9d3fb97 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:12.371026 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-f04e2887-8477-4be8-bbcc-bfb3e9d3fb97 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:33:12.379486 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-f04e2887-8477-4be8-bbcc-bfb3e9d3fb97 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:33:12.380993 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-f04e2887-8477-4be8-bbcc-bfb3e9d3fb97 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:33:12.382629 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-f04e2887-8477-4be8-bbcc-bfb3e9d3fb97 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1805 microversion: 2.20 time: 0.150326 Jun 07 09:33:12.383178 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 303/603] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:33:12 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1805 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:33:13.400768 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-ad1181d2-2423-435b-97e6-c3205a0a2e9f tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:33:13.401287 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-ad1181d2-2423-435b-97e6-c3205a0a2e9f tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:33:13.403149 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writing DB stats nova_api:SELECT=26 {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:33:13.407871 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-ad1181d2-2423-435b-97e6-c3205a0a2e9f tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:13.408321 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-ad1181d2-2423-435b-97e6-c3205a0a2e9f tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:13.409114 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-ad1181d2-2423-435b-97e6-c3205a0a2e9f tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:13.409549 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-ad1181d2-2423-435b-97e6-c3205a0a2e9f tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:13.535259 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-ad1181d2-2423-435b-97e6-c3205a0a2e9f tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:33:13.544217 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-ad1181d2-2423-435b-97e6-c3205a0a2e9f tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:33:13.545759 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-ad1181d2-2423-435b-97e6-c3205a0a2e9f tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:33:13.546910 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-ad1181d2-2423-435b-97e6-c3205a0a2e9f tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1805 microversion: 2.20 time: 0.150697 Jun 07 09:33:13.547461 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 301/604] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:33:13 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1805 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:33:14.400186 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [req-66c0044b-6293-4df1-a739-c0936457fec5 req-95b0927f-2cb9-4375-a688-35a7827945cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "102039c7-8224-43f7-9fb8-90b82968cfa2", "name": "network-vif-plugged", "status": "completed", "tag": "647bfcc4-5bf0-429c-803e-b72ea4c0fa25"}]} {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:33:14.408783 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [req-66c0044b-6293-4df1-a739-c0936457fec5 req-95b0927f-2cb9-4375-a688-35a7827945cc service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:14.409231 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [req-66c0044b-6293-4df1-a739-c0936457fec5 req-95b0927f-2cb9-4375-a688-35a7827945cc service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:14.422450 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.compute.server_external_events [req-66c0044b-6293-4df1-a739-c0936457fec5 req-95b0927f-2cb9-4375-a688-35a7827945cc service nova] Creating event network-vif-plugged:647bfcc4-5bf0-429c-803e-b72ea4c0fa25 for instance 102039c7-8224-43f7-9fb8-90b82968cfa2 on hv-cinder-83699 Jun 07 09:33:14.427521 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [req-66c0044b-6293-4df1-a739-c0936457fec5 req-95b0927f-2cb9-4375-a688-35a7827945cc service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031089 Jun 07 09:33:14.428091 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 304/605] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Jun 7 09:33:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 09:33:14.565267 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-865207c8-8b08-4a63-9bec-e2a731518ea6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:33:14.565892 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-865207c8-8b08-4a63-9bec-e2a731518ea6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:33:14.571868 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-865207c8-8b08-4a63-9bec-e2a731518ea6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:14.572305 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-865207c8-8b08-4a63-9bec-e2a731518ea6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:14.573084 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-865207c8-8b08-4a63-9bec-e2a731518ea6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:14.573513 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-865207c8-8b08-4a63-9bec-e2a731518ea6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:14.701784 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-865207c8-8b08-4a63-9bec-e2a731518ea6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:33:14.710102 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-865207c8-8b08-4a63-9bec-e2a731518ea6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:33:14.711560 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-865207c8-8b08-4a63-9bec-e2a731518ea6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:33:14.712714 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-865207c8-8b08-4a63-9bec-e2a731518ea6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1805 microversion: 2.20 time: 0.151311 Jun 07 09:33:14.713272 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 302/606] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:33:14 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1805 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:33:15.732320 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-70041f74-ce45-4655-b741-982b68fbc0ae tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:33:15.733049 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-70041f74-ce45-4655-b741-982b68fbc0ae tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:33:15.739153 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-70041f74-ce45-4655-b741-982b68fbc0ae tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:15.739604 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-70041f74-ce45-4655-b741-982b68fbc0ae tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:15.740369 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-70041f74-ce45-4655-b741-982b68fbc0ae tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:15.740834 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-70041f74-ce45-4655-b741-982b68fbc0ae tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:15.870257 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-70041f74-ce45-4655-b741-982b68fbc0ae tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:33:15.878717 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-70041f74-ce45-4655-b741-982b68fbc0ae tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:33:15.880234 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-70041f74-ce45-4655-b741-982b68fbc0ae tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:33:15.881452 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-70041f74-ce45-4655-b741-982b68fbc0ae tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1805 microversion: 2.20 time: 0.154150 Jun 07 09:33:15.887281 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 305/607] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:33:15 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1805 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:33:16.899632 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-38b6c5f2-88a3-4154-9d75-3577545c6912 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:33:16.900247 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-38b6c5f2-88a3-4154-9d75-3577545c6912 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:33:16.906469 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-38b6c5f2-88a3-4154-9d75-3577545c6912 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:16.906948 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-38b6c5f2-88a3-4154-9d75-3577545c6912 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:16.907707 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-38b6c5f2-88a3-4154-9d75-3577545c6912 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:16.908144 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-38b6c5f2-88a3-4154-9d75-3577545c6912 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:17.043545 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-38b6c5f2-88a3-4154-9d75-3577545c6912 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:33:17.049992 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-38b6c5f2-88a3-4154-9d75-3577545c6912 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:33:17.051511 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-38b6c5f2-88a3-4154-9d75-3577545c6912 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:33:17.052696 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-38b6c5f2-88a3-4154-9d75-3577545c6912 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1805 microversion: 2.20 time: 0.156980 Jun 07 09:33:17.053248 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 303/608] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:33:16 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1805 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:33:17.852338 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-ecc8173f-c3ab-4448-be2b-37c4394345d8 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3bbd6c72-6020-44c6-86cf-220d349a1e1e"}} {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:33:17.853418 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-ecc8173f-c3ab-4448-be2b-37c4394345d8 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8b9ef09-4309-4fb4-86c8-1f7499c44e75] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:33:17.856132 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writing DB stats nova_api:SELECT=28 {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:33:17.860879 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-ecc8173f-c3ab-4448-be2b-37c4394345d8 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:17.861330 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-ecc8173f-c3ab-4448-be2b-37c4394345d8 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:17.862086 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-ecc8173f-c3ab-4448-be2b-37c4394345d8 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:17.862565 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-ecc8173f-c3ab-4448-be2b-37c4394345d8 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:18.071332 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-d4e58754-291a-4933-a32b-8dec73cf7f18 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:33:18.071944 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-d4e58754-291a-4933-a32b-8dec73cf7f18 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:33:18.078120 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-d4e58754-291a-4933-a32b-8dec73cf7f18 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:18.080304 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-d4e58754-291a-4933-a32b-8dec73cf7f18 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:18.080304 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-d4e58754-291a-4933-a32b-8dec73cf7f18 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:18.080304 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-d4e58754-291a-4933-a32b-8dec73cf7f18 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:18.082333 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writing DB stats nova_cell1:SELECT=84 {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:33:18.210103 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-d4e58754-291a-4933-a32b-8dec73cf7f18 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:33:18.237117 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-d4e58754-291a-4933-a32b-8dec73cf7f18 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:33:18.238568 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-d4e58754-291a-4933-a32b-8dec73cf7f18 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:33:18.239734 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-d4e58754-291a-4933-a32b-8dec73cf7f18 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1805 microversion: 2.20 time: 0.172394 Jun 07 09:33:18.240288 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 304/609] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:33:18 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1805 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 09:33:18.658834 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-ecc8173f-c3ab-4448-be2b-37c4394345d8 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "POST /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.810900 Jun 07 09:33:18.659621 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 306/610] 10.222.0.57 () {60 vars in 1322 bytes} [Tue Jun 7 09:33:17 2022] POST /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75/os-volume_attachments => generated 194 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:33:19.258799 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-ef53972f-abdf-4cb0-9b98-393490459e9e tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:33:19.259442 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-ef53972f-abdf-4cb0-9b98-393490459e9e tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:33:19.271510 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-ef53972f-abdf-4cb0-9b98-393490459e9e tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:19.271510 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-ef53972f-abdf-4cb0-9b98-393490459e9e tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:19.271510 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-ef53972f-abdf-4cb0-9b98-393490459e9e tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:19.271510 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-ef53972f-abdf-4cb0-9b98-393490459e9e tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:19.396499 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-ef53972f-abdf-4cb0-9b98-393490459e9e tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:33:19.405434 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-ef53972f-abdf-4cb0-9b98-393490459e9e tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:33:19.406977 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-ef53972f-abdf-4cb0-9b98-393490459e9e tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:33:19.408118 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-ef53972f-abdf-4cb0-9b98-393490459e9e tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1792 microversion: 2.20 time: 0.153572 Jun 07 09:33:19.408695 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 305/611] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:33:19 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1792 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:33:24.218832 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-9e38a592-99a1-444e-9e37-1c6482a6b172 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:33:24.219537 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-9e38a592-99a1-444e-9e37-1c6482a6b172 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:33:24.227624 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-9e38a592-99a1-444e-9e37-1c6482a6b172 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:24.228177 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-9e38a592-99a1-444e-9e37-1c6482a6b172 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:24.229080 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-9e38a592-99a1-444e-9e37-1c6482a6b172 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:24.229999 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-9e38a592-99a1-444e-9e37-1c6482a6b172 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:24.548541 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.objects.instance [None req-9e38a592-99a1-444e-9e37-1c6482a6b172 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lazy-loading 'services' on Instance uuid 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 {{(pid=118740) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 09:33:24.831510 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-9e38a592-99a1-444e-9e37-1c6482a6b172 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "DELETE /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25/os-volume_attachments/1614fd19-6fec-47e8-95c4-e42fa3f07102" status: 202 len: 0 microversion: 2.1 time: 0.618915 Jun 07 09:33:24.832114 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 307/612] 10.222.0.57 () {58 vars in 1415 bytes} [Tue Jun 7 09:33:24 2022] DELETE /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25/os-volume_attachments/1614fd19-6fec-47e8-95c4-e42fa3f07102 => generated 0 bytes in 621 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 09:33:27.241346 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-148a49d2-f8d6-452d-a22e-5c5a7fc79160 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:33:27.243099 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-148a49d2-f8d6-452d-a22e-5c5a7fc79160 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8b9ef09-4309-4fb4-86c8-1f7499c44e75] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:33:27.249718 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-148a49d2-f8d6-452d-a22e-5c5a7fc79160 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:27.250166 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-148a49d2-f8d6-452d-a22e-5c5a7fc79160 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:27.250930 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-148a49d2-f8d6-452d-a22e-5c5a7fc79160 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:27.251361 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-148a49d2-f8d6-452d-a22e-5c5a7fc79160 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:27.276750 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.objects.instance [None req-148a49d2-f8d6-452d-a22e-5c5a7fc79160 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lazy-loading 'flavor' on Instance uuid a8b9ef09-4309-4fb4-86c8-1f7499c44e75 {{(pid=118741) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 09:33:27.614818 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-148a49d2-f8d6-452d-a22e-5c5a7fc79160 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "POST /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75/action" status: 200 len: 32 microversion: 2.1 time: 0.377529 Jun 07 09:33:27.617361 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 306/613] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Jun 7 09:33:27 2022] POST /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75/action => generated 32 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 07 09:33:27.628531 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-1a4bdfcc-758e-4892-9975-9943e371542b tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:33:27.630240 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-1a4bdfcc-758e-4892-9975-9943e371542b tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8b9ef09-4309-4fb4-86c8-1f7499c44e75] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:33:27.646498 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-1a4bdfcc-758e-4892-9975-9943e371542b tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:27.647213 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-1a4bdfcc-758e-4892-9975-9943e371542b tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:27.648221 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-1a4bdfcc-758e-4892-9975-9943e371542b tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:27.648897 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-1a4bdfcc-758e-4892-9975-9943e371542b tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:27.827536 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-1a4bdfcc-758e-4892-9975-9943e371542b tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:33:27.836446 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-1a4bdfcc-758e-4892-9975-9943e371542b tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75" status: 200 len: 1736 microversion: 2.1 time: 0.214548 Jun 07 09:33:27.853283 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 308/614] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:33:27 2022] GET /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75 => generated 1736 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:33:28.854556 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-abfb0fb6-0185-410b-b0cd-3a09ecc33a18 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:33:28.855251 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-abfb0fb6-0185-410b-b0cd-3a09ecc33a18 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8b9ef09-4309-4fb4-86c8-1f7499c44e75] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:33:28.863823 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-abfb0fb6-0185-410b-b0cd-3a09ecc33a18 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:28.864272 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-abfb0fb6-0185-410b-b0cd-3a09ecc33a18 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:28.865075 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-abfb0fb6-0185-410b-b0cd-3a09ecc33a18 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:28.865511 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-abfb0fb6-0185-410b-b0cd-3a09ecc33a18 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:29.088434 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-abfb0fb6-0185-410b-b0cd-3a09ecc33a18 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:33:29.109103 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-abfb0fb6-0185-410b-b0cd-3a09ecc33a18 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75" status: 200 len: 1736 microversion: 2.1 time: 0.259233 Jun 07 09:33:29.109981 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 307/615] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:33:28 2022] GET /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75 => generated 1736 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:33:29.154746 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-b69ee8e2-af6a-4e41-b86d-a0a3839a26a2 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:33:29.162310 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b69ee8e2-af6a-4e41-b86d-a0a3839a26a2 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:29.162805 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b69ee8e2-af6a-4e41-b86d-a0a3839a26a2 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:29.185982 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-b69ee8e2-af6a-4e41-b86d-a0a3839a26a2 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25] Going to try to stop instance {{(pid=118740) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 07 09:33:29.401854 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-b69ee8e2-af6a-4e41-b86d-a0a3839a26a2 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "POST /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25/action" status: 202 len: 0 microversion: 2.1 time: 0.251695 Jun 07 09:33:29.407422 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 309/616] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Jun 7 09:33:29 2022] POST /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25/action => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 09:33:29.415307 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-618e69fb-ca16-4571-8212-f93d1431d195 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:33:29.416201 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-618e69fb-ca16-4571-8212-f93d1431d195 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:33:29.426044 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-618e69fb-ca16-4571-8212-f93d1431d195 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:29.426499 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-618e69fb-ca16-4571-8212-f93d1431d195 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:29.427281 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-618e69fb-ca16-4571-8212-f93d1431d195 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:29.427722 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-618e69fb-ca16-4571-8212-f93d1431d195 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:29.608644 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-618e69fb-ca16-4571-8212-f93d1431d195 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0346f4e3855142059983083e71c2c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c21b1cbbd604d6d9c97ab7c3c788f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:33:29.616629 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-618e69fb-ca16-4571-8212-f93d1431d195 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25" status: 200 len: 1676 microversion: 2.1 time: 0.206080 Jun 07 09:33:29.617201 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 308/617] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:33:29 2022] GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 => generated 1676 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:33:30.127390 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-ae01294b-8cd9-453b-a2bd-0c72512f32e1 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:33:30.128094 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-ae01294b-8cd9-453b-a2bd-0c72512f32e1 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8b9ef09-4309-4fb4-86c8-1f7499c44e75] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:33:30.137322 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-ae01294b-8cd9-453b-a2bd-0c72512f32e1 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:30.138100 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-ae01294b-8cd9-453b-a2bd-0c72512f32e1 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:30.141826 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-ae01294b-8cd9-453b-a2bd-0c72512f32e1 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:30.141826 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-ae01294b-8cd9-453b-a2bd-0c72512f32e1 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:30.277475 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-ae01294b-8cd9-453b-a2bd-0c72512f32e1 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:33:30.291276 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-ae01294b-8cd9-453b-a2bd-0c72512f32e1 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75" status: 200 len: 1736 microversion: 2.1 time: 0.162486 Jun 07 09:33:30.291276 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 310/618] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:33:30 2022] GET /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:33:30.920438 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-918a3134-0f29-4938-80c2-cb746bcacf68 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:33:30.926840 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-918a3134-0f29-4938-80c2-cb746bcacf68 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:33:30.927178 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-918a3134-0f29-4938-80c2-cb746bcacf68 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:30.927632 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-918a3134-0f29-4938-80c2-cb746bcacf68 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:30.928394 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-918a3134-0f29-4938-80c2-cb746bcacf68 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:30.928989 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-918a3134-0f29-4938-80c2-cb746bcacf68 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:31.107999 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-918a3134-0f29-4938-80c2-cb746bcacf68 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0346f4e3855142059983083e71c2c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c21b1cbbd604d6d9c97ab7c3c788f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:33:31.115971 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-918a3134-0f29-4938-80c2-cb746bcacf68 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25" status: 200 len: 1676 microversion: 2.1 time: 0.485737 Jun 07 09:33:31.116605 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 309/619] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:33:30 2022] GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 => generated 1676 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:33:31.302693 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-22877af9-0278-4396-b547-5f5b6b872b61 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:33:31.303305 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-22877af9-0278-4396-b547-5f5b6b872b61 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8b9ef09-4309-4fb4-86c8-1f7499c44e75] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:33:31.309800 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-22877af9-0278-4396-b547-5f5b6b872b61 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:31.310241 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-22877af9-0278-4396-b547-5f5b6b872b61 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:31.311007 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-22877af9-0278-4396-b547-5f5b6b872b61 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:31.311437 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-22877af9-0278-4396-b547-5f5b6b872b61 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:31.453055 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-22877af9-0278-4396-b547-5f5b6b872b61 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:33:31.461708 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-22877af9-0278-4396-b547-5f5b6b872b61 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75" status: 200 len: 1736 microversion: 2.1 time: 0.162832 Jun 07 09:33:31.467683 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 311/620] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:33:31 2022] GET /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:33:32.136283 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-1dbf6bac-a3f9-4c9b-9cce-51c6780b7e53 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:33:32.137073 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-1dbf6bac-a3f9-4c9b-9cce-51c6780b7e53 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:33:32.144920 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-1dbf6bac-a3f9-4c9b-9cce-51c6780b7e53 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:32.145704 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-1dbf6bac-a3f9-4c9b-9cce-51c6780b7e53 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:32.147084 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-1dbf6bac-a3f9-4c9b-9cce-51c6780b7e53 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:32.149013 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-1dbf6bac-a3f9-4c9b-9cce-51c6780b7e53 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:32.326962 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-1dbf6bac-a3f9-4c9b-9cce-51c6780b7e53 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0346f4e3855142059983083e71c2c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c21b1cbbd604d6d9c97ab7c3c788f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:33:32.335840 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-1dbf6bac-a3f9-4c9b-9cce-51c6780b7e53 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25" status: 200 len: 1676 microversion: 2.1 time: 0.203951 Jun 07 09:33:32.336778 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 310/621] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:33:32 2022] GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 => generated 1676 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:33:32.479220 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-b2d5b560-71a2-48a1-839e-339a5894f0ae tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:33:32.479844 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-b2d5b560-71a2-48a1-839e-339a5894f0ae tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8b9ef09-4309-4fb4-86c8-1f7499c44e75] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:33:32.489312 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b2d5b560-71a2-48a1-839e-339a5894f0ae tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:32.495388 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b2d5b560-71a2-48a1-839e-339a5894f0ae tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:32.495388 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b2d5b560-71a2-48a1-839e-339a5894f0ae tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:32.495388 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b2d5b560-71a2-48a1-839e-339a5894f0ae tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:32.664280 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-b2d5b560-71a2-48a1-839e-339a5894f0ae tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:33:32.672880 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-b2d5b560-71a2-48a1-839e-339a5894f0ae tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75" status: 200 len: 1736 microversion: 2.1 time: 0.197644 Jun 07 09:33:32.673448 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 312/622] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:33:32 2022] GET /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75 => generated 1736 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:33:33.353773 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-dd9b2247-92ce-425c-b690-529d5af5e30b tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:33:33.355035 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-dd9b2247-92ce-425c-b690-529d5af5e30b tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:33:33.361710 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-dd9b2247-92ce-425c-b690-529d5af5e30b tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:33.362408 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-dd9b2247-92ce-425c-b690-529d5af5e30b tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:33.363351 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-dd9b2247-92ce-425c-b690-529d5af5e30b tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:33.363975 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-dd9b2247-92ce-425c-b690-529d5af5e30b tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:33.691727 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-6043b648-fa18-488b-bdac-340d98468a83 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:33:33.694167 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-6043b648-fa18-488b-bdac-340d98468a83 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8b9ef09-4309-4fb4-86c8-1f7499c44e75] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:33:33.709529 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-6043b648-fa18-488b-bdac-340d98468a83 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:33.710841 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-6043b648-fa18-488b-bdac-340d98468a83 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:33.711859 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-6043b648-fa18-488b-bdac-340d98468a83 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:33.712655 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-6043b648-fa18-488b-bdac-340d98468a83 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:33.781656 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-dd9b2247-92ce-425c-b690-529d5af5e30b tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0346f4e3855142059983083e71c2c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c21b1cbbd604d6d9c97ab7c3c788f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:33:33.791250 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-dd9b2247-92ce-425c-b690-529d5af5e30b tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25" status: 200 len: 1676 microversion: 2.1 time: 0.441889 Jun 07 09:33:33.796380 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 311/623] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:33:33 2022] GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 => generated 1676 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:33:33.921942 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-6043b648-fa18-488b-bdac-340d98468a83 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:33:33.931193 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-6043b648-fa18-488b-bdac-340d98468a83 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75" status: 200 len: 1736 microversion: 2.1 time: 0.244573 Jun 07 09:33:33.932073 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 313/624] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:33:33 2022] GET /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75 => generated 1736 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:33:34.829089 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-4cd3cd9d-7ff9-4fbb-9240-dfdaa02e78bf tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:33:34.829713 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-4cd3cd9d-7ff9-4fbb-9240-dfdaa02e78bf tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:33:34.841932 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-4cd3cd9d-7ff9-4fbb-9240-dfdaa02e78bf tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:34.842395 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-4cd3cd9d-7ff9-4fbb-9240-dfdaa02e78bf tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:34.843187 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-4cd3cd9d-7ff9-4fbb-9240-dfdaa02e78bf tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:34.843827 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-4cd3cd9d-7ff9-4fbb-9240-dfdaa02e78bf tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:34.949304 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-d48e91ac-63a9-433a-9c8b-b3931367de81 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:33:34.950583 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-d48e91ac-63a9-433a-9c8b-b3931367de81 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8b9ef09-4309-4fb4-86c8-1f7499c44e75] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:33:34.961324 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-d48e91ac-63a9-433a-9c8b-b3931367de81 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:34.961878 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-d48e91ac-63a9-433a-9c8b-b3931367de81 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:34.962734 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-d48e91ac-63a9-433a-9c8b-b3931367de81 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:34.963247 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-d48e91ac-63a9-433a-9c8b-b3931367de81 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:34.966347 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:33:34.999865 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-4cd3cd9d-7ff9-4fbb-9240-dfdaa02e78bf tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0346f4e3855142059983083e71c2c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c21b1cbbd604d6d9c97ab7c3c788f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:33:35.024110 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-4cd3cd9d-7ff9-4fbb-9240-dfdaa02e78bf tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25" status: 200 len: 1676 microversion: 2.1 time: 0.200163 Jun 07 09:33:35.024964 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 312/625] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:33:34 2022] GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 => generated 1676 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:33:35.120781 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-d48e91ac-63a9-433a-9c8b-b3931367de81 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:33:35.129033 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-d48e91ac-63a9-433a-9c8b-b3931367de81 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75" status: 200 len: 1736 microversion: 2.1 time: 0.184054 Jun 07 09:33:35.129624 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 314/626] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:33:34 2022] GET /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75 => generated 1736 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:33:35.647272 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-44fb58c6-a5fb-474c-961c-2e592d5f6ad3 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Action: 'create', calling method: .version_select at 0x7f5c928b6c10>, body: {"keypair": {"name": "tempest-TestShelveInstance-2083521930", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBClgCXcTIKpAWcvCZARmzoTXWZF5oY+7i6GGB2loiE/zg06kR0yweXNSqLrcsaZC0Ypvc51fb6ZKi6NRtTNEaPusFC0itgYh4/vaYKLV5p749eVAPxJHQ9uOLa85fyc0ZQ=="}} {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:33:35.662933 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.quota [None req-44fb58c6-a5fb-474c-961c-2e592d5f6ad3 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Getting quotas for project ae0e917f30d3430bb088ca3d0afe1a02. Resources: {'key_pairs'} {{(pid=118741) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 09:33:35.667462 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.quota [None req-44fb58c6-a5fb-474c-961c-2e592d5f6ad3 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Getting quotas for user 9db3cd25f4c94640854677709d10ccbe and project ae0e917f30d3430bb088ca3d0afe1a02. Resources: {'key_pairs'} {{(pid=118741) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 09:33:35.753245 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-44fb58c6-a5fb-474c-961c-2e592d5f6ad3 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.210740 Jun 07 09:33:35.753843 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 313/627] 10.222.0.57 () {60 vars in 1158 bytes} [Tue Jun 7 09:33:35 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:33:36.050724 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-1d7550aa-5821-4378-a820-591b723f8a65 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:33:36.051370 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-1d7550aa-5821-4378-a820-591b723f8a65 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:33:36.062117 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-1d7550aa-5821-4378-a820-591b723f8a65 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:36.065067 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-1d7550aa-5821-4378-a820-591b723f8a65 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:36.065067 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-1d7550aa-5821-4378-a820-591b723f8a65 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:36.065067 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-1d7550aa-5821-4378-a820-591b723f8a65 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:36.147914 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-6864eda2-1a2a-4d30-8e0e-d6fd3d80433b tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:33:36.148527 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-6864eda2-1a2a-4d30-8e0e-d6fd3d80433b tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8b9ef09-4309-4fb4-86c8-1f7499c44e75] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:33:36.155800 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-6864eda2-1a2a-4d30-8e0e-d6fd3d80433b tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:36.156575 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-6864eda2-1a2a-4d30-8e0e-d6fd3d80433b tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:36.157812 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-6864eda2-1a2a-4d30-8e0e-d6fd3d80433b tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:36.158369 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-6864eda2-1a2a-4d30-8e0e-d6fd3d80433b tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:36.226503 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-1d7550aa-5821-4378-a820-591b723f8a65 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0346f4e3855142059983083e71c2c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c21b1cbbd604d6d9c97ab7c3c788f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:33:36.234390 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-1d7550aa-5821-4378-a820-591b723f8a65 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25" status: 200 len: 1676 microversion: 2.1 time: 0.196317 Jun 07 09:33:36.235070 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 315/628] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:33:36 2022] GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 => generated 1676 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:33:36.300427 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-6864eda2-1a2a-4d30-8e0e-d6fd3d80433b tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:33:36.309721 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-6864eda2-1a2a-4d30-8e0e-d6fd3d80433b tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75" status: 200 len: 1736 microversion: 2.1 time: 0.165998 Jun 07 09:33:36.315656 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 314/629] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:33:36 2022] GET /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75 => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:33:37.251485 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-9bf74711-0e51-4930-ace4-4be6cd645cfe tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:33:37.257232 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-9bf74711-0e51-4930-ace4-4be6cd645cfe tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:33:37.261077 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-9bf74711-0e51-4930-ace4-4be6cd645cfe tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:37.261831 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-9bf74711-0e51-4930-ace4-4be6cd645cfe tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:37.262535 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-9bf74711-0e51-4930-ace4-4be6cd645cfe tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:37.262985 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-9bf74711-0e51-4930-ace4-4be6cd645cfe tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:37.330567 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-752aa5c9-a79e-4c94-966a-43591a5a191b tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:33:37.331281 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-752aa5c9-a79e-4c94-966a-43591a5a191b tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8b9ef09-4309-4fb4-86c8-1f7499c44e75] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:33:37.342108 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-752aa5c9-a79e-4c94-966a-43591a5a191b tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:37.342791 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-752aa5c9-a79e-4c94-966a-43591a5a191b tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:37.350094 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-752aa5c9-a79e-4c94-966a-43591a5a191b tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:37.350796 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-752aa5c9-a79e-4c94-966a-43591a5a191b tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:37.564394 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-9bf74711-0e51-4930-ace4-4be6cd645cfe tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0346f4e3855142059983083e71c2c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c21b1cbbd604d6d9c97ab7c3c788f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:33:37.574923 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-752aa5c9-a79e-4c94-966a-43591a5a191b tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:33:37.580653 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-9bf74711-0e51-4930-ace4-4be6cd645cfe tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25" status: 200 len: 1676 microversion: 2.1 time: 0.333086 Jun 07 09:33:37.581356 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 316/630] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:33:37 2022] GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 => generated 1676 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:33:37.595085 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-752aa5c9-a79e-4c94-966a-43591a5a191b tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75" status: 200 len: 1736 microversion: 2.1 time: 0.268265 Jun 07 09:33:37.598484 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 315/631] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:33:37 2022] GET /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75 => generated 1736 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:33:38.598302 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-2374cb2d-f773-41a8-aba4-17d4b3c0647d tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:33:38.598930 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-2374cb2d-f773-41a8-aba4-17d4b3c0647d tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:33:38.607080 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-2374cb2d-f773-41a8-aba4-17d4b3c0647d tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:38.607590 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-2374cb2d-f773-41a8-aba4-17d4b3c0647d tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:38.608367 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-2374cb2d-f773-41a8-aba4-17d4b3c0647d tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:38.608842 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-2374cb2d-f773-41a8-aba4-17d4b3c0647d tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:38.617496 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-7fbf9cbe-db1d-40c4-bd0d-7137af1da3c3 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:33:38.618803 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-7fbf9cbe-db1d-40c4-bd0d-7137af1da3c3 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8b9ef09-4309-4fb4-86c8-1f7499c44e75] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:33:38.625299 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-7fbf9cbe-db1d-40c4-bd0d-7137af1da3c3 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:38.626040 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-7fbf9cbe-db1d-40c4-bd0d-7137af1da3c3 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:38.627020 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-7fbf9cbe-db1d-40c4-bd0d-7137af1da3c3 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:38.627942 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-7fbf9cbe-db1d-40c4-bd0d-7137af1da3c3 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:38.757769 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-2374cb2d-f773-41a8-aba4-17d4b3c0647d tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0346f4e3855142059983083e71c2c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c21b1cbbd604d6d9c97ab7c3c788f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:33:38.765649 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-2374cb2d-f773-41a8-aba4-17d4b3c0647d tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25" status: 200 len: 1676 microversion: 2.1 time: 0.171450 Jun 07 09:33:38.766505 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 317/632] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:33:38 2022] GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 => generated 1676 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:33:38.785560 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-7fbf9cbe-db1d-40c4-bd0d-7137af1da3c3 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:33:38.794514 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-7fbf9cbe-db1d-40c4-bd0d-7137af1da3c3 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75" status: 200 len: 1736 microversion: 2.1 time: 0.181691 Jun 07 09:33:38.795092 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 316/633] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:33:38 2022] GET /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75 => generated 1736 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:33:39.783033 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-cc0023f9-35e4-490e-9ac7-b4c9c0b618da tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:33:39.783680 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-cc0023f9-35e4-490e-9ac7-b4c9c0b618da tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:33:39.790232 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-cc0023f9-35e4-490e-9ac7-b4c9c0b618da tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:39.792280 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-cc0023f9-35e4-490e-9ac7-b4c9c0b618da tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:39.792280 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-cc0023f9-35e4-490e-9ac7-b4c9c0b618da tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:39.792280 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-cc0023f9-35e4-490e-9ac7-b4c9c0b618da tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:39.937946 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-cc0023f9-35e4-490e-9ac7-b4c9c0b618da tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0346f4e3855142059983083e71c2c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c21b1cbbd604d6d9c97ab7c3c788f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:33:39.948765 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-cc0023f9-35e4-490e-9ac7-b4c9c0b618da tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25" status: 200 len: 1676 microversion: 2.1 time: 0.169381 Jun 07 09:33:39.949155 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-23534bb5-010f-4655-99f8-6eb838f8bd75 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:33:39.949646 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 318/634] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:33:39 2022] GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 => generated 1676 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:33:39.949895 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-23534bb5-010f-4655-99f8-6eb838f8bd75 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8b9ef09-4309-4fb4-86c8-1f7499c44e75] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:33:39.956918 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-23534bb5-010f-4655-99f8-6eb838f8bd75 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:39.957397 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-23534bb5-010f-4655-99f8-6eb838f8bd75 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:39.958639 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-23534bb5-010f-4655-99f8-6eb838f8bd75 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:39.958639 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-23534bb5-010f-4655-99f8-6eb838f8bd75 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:40.097548 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-23534bb5-010f-4655-99f8-6eb838f8bd75 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:33:40.106390 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-23534bb5-010f-4655-99f8-6eb838f8bd75 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75" status: 200 len: 1736 microversion: 2.1 time: 0.299148 Jun 07 09:33:40.106939 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 317/635] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:33:39 2022] GET /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75 => generated 1736 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:33:40.966590 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-af763ed6-d092-42b3-a5a1-2078fe09bc06 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:33:40.967208 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-af763ed6-d092-42b3-a5a1-2078fe09bc06 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:33:40.973764 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-af763ed6-d092-42b3-a5a1-2078fe09bc06 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:40.974245 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-af763ed6-d092-42b3-a5a1-2078fe09bc06 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:40.975016 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-af763ed6-d092-42b3-a5a1-2078fe09bc06 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:40.977438 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-af763ed6-d092-42b3-a5a1-2078fe09bc06 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:41.106520 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-af763ed6-d092-42b3-a5a1-2078fe09bc06 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0346f4e3855142059983083e71c2c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c21b1cbbd604d6d9c97ab7c3c788f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:33:41.114640 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-af763ed6-d092-42b3-a5a1-2078fe09bc06 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25" status: 200 len: 1653 microversion: 2.1 time: 0.152156 Jun 07 09:33:41.115269 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 319/636] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:33:40 2022] GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 => generated 1653 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:33:41.123322 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-fd27860e-6d24-4db6-ab4f-34131ac82f8f tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:33:41.123923 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-fd27860e-6d24-4db6-ab4f-34131ac82f8f tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8b9ef09-4309-4fb4-86c8-1f7499c44e75] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:33:41.130028 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-fd27860e-6d24-4db6-ab4f-34131ac82f8f tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:41.130469 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-fd27860e-6d24-4db6-ab4f-34131ac82f8f tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:41.131224 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-fd27860e-6d24-4db6-ab4f-34131ac82f8f tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:41.131652 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-fd27860e-6d24-4db6-ab4f-34131ac82f8f tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:41.131907 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-071a5f7a-67aa-4dd7-9d72-65b01dd5f22a tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:33:41.139207 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-071a5f7a-67aa-4dd7-9d72-65b01dd5f22a tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:41.139663 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-071a5f7a-67aa-4dd7-9d72-65b01dd5f22a tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:41.163190 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-071a5f7a-67aa-4dd7-9d72-65b01dd5f22a tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25] Going to try to start instance {{(pid=118740) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 07 09:33:41.263574 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-fd27860e-6d24-4db6-ab4f-34131ac82f8f tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:33:41.271736 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-fd27860e-6d24-4db6-ab4f-34131ac82f8f tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75" status: 200 len: 1736 microversion: 2.1 time: 0.152267 Jun 07 09:33:41.272298 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 318/637] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:33:41 2022] GET /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:33:41.338202 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-071a5f7a-67aa-4dd7-9d72-65b01dd5f22a tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "POST /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25/action" status: 202 len: 0 microversion: 2.1 time: 0.209989 Jun 07 09:33:41.338796 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 320/638] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Jun 7 09:33:41 2022] POST /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25/action => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 07 09:33:41.346830 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-7ec2c119-97b9-4cf5-8cf1-715c62906e9b tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:33:41.347444 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-7ec2c119-97b9-4cf5-8cf1-715c62906e9b tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:33:41.353840 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-7ec2c119-97b9-4cf5-8cf1-715c62906e9b tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:41.354291 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-7ec2c119-97b9-4cf5-8cf1-715c62906e9b tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:41.355048 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-7ec2c119-97b9-4cf5-8cf1-715c62906e9b tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:41.355791 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-7ec2c119-97b9-4cf5-8cf1-715c62906e9b tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:41.488563 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-7ec2c119-97b9-4cf5-8cf1-715c62906e9b tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0346f4e3855142059983083e71c2c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c21b1cbbd604d6d9c97ab7c3c788f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:33:41.490875 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:33:41.497424 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-7ec2c119-97b9-4cf5-8cf1-715c62906e9b tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25" status: 200 len: 1662 microversion: 2.1 time: 0.154465 Jun 07 09:33:41.497984 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 319/639] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:33:41 2022] GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 => generated 1662 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:33:42.291144 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-752fe8a1-0751-4722-be02-a6c753a2a410 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:33:42.291797 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-752fe8a1-0751-4722-be02-a6c753a2a410 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8b9ef09-4309-4fb4-86c8-1f7499c44e75] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:33:42.298027 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-752fe8a1-0751-4722-be02-a6c753a2a410 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:42.298510 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-752fe8a1-0751-4722-be02-a6c753a2a410 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:42.299274 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-752fe8a1-0751-4722-be02-a6c753a2a410 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:42.299713 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-752fe8a1-0751-4722-be02-a6c753a2a410 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:42.477343 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-752fe8a1-0751-4722-be02-a6c753a2a410 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:33:42.485748 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-752fe8a1-0751-4722-be02-a6c753a2a410 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75" status: 200 len: 1736 microversion: 2.1 time: 0.199550 Jun 07 09:33:42.486314 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 321/640] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:33:42 2022] GET /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75 => generated 1736 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:33:42.515249 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-dae893f9-89e9-40af-a309-4030432f9487 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:33:42.515849 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-dae893f9-89e9-40af-a309-4030432f9487 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:33:42.523143 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-dae893f9-89e9-40af-a309-4030432f9487 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:42.523733 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-dae893f9-89e9-40af-a309-4030432f9487 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:42.524668 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-dae893f9-89e9-40af-a309-4030432f9487 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:42.528248 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-dae893f9-89e9-40af-a309-4030432f9487 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:42.656554 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-dae893f9-89e9-40af-a309-4030432f9487 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0346f4e3855142059983083e71c2c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c21b1cbbd604d6d9c97ab7c3c788f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:33:42.664078 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-dae893f9-89e9-40af-a309-4030432f9487 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25" status: 200 len: 1662 microversion: 2.1 time: 0.152986 Jun 07 09:33:42.664731 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 320/641] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:33:42 2022] GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 => generated 1662 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:33:43.501944 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-ee846104-d2ea-47e4-8713-401a57a9c7b6 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:33:43.502565 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-ee846104-d2ea-47e4-8713-401a57a9c7b6 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8b9ef09-4309-4fb4-86c8-1f7499c44e75] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:33:43.511550 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-ee846104-d2ea-47e4-8713-401a57a9c7b6 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:43.512006 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-ee846104-d2ea-47e4-8713-401a57a9c7b6 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:43.512819 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-ee846104-d2ea-47e4-8713-401a57a9c7b6 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:43.513259 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-ee846104-d2ea-47e4-8713-401a57a9c7b6 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:43.655570 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-ee846104-d2ea-47e4-8713-401a57a9c7b6 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:33:43.663804 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-ee846104-d2ea-47e4-8713-401a57a9c7b6 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75" status: 200 len: 1736 microversion: 2.1 time: 0.165808 Jun 07 09:33:43.664370 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 322/642] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:33:43 2022] GET /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75 => generated 1736 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:33:43.681611 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-a538f4bc-92e5-480c-aeda-2b75aeb4d162 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:33:43.682221 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-a538f4bc-92e5-480c-aeda-2b75aeb4d162 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:33:43.684102 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=1 {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:33:43.689051 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-a538f4bc-92e5-480c-aeda-2b75aeb4d162 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:43.707906 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-a538f4bc-92e5-480c-aeda-2b75aeb4d162 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:43.707906 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-a538f4bc-92e5-480c-aeda-2b75aeb4d162 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:43.707906 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-a538f4bc-92e5-480c-aeda-2b75aeb4d162 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:43.825756 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-a538f4bc-92e5-480c-aeda-2b75aeb4d162 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0346f4e3855142059983083e71c2c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c21b1cbbd604d6d9c97ab7c3c788f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:33:43.833687 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-a538f4bc-92e5-480c-aeda-2b75aeb4d162 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25" status: 200 len: 1662 microversion: 2.1 time: 0.155905 Jun 07 09:33:43.834428 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 321/643] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:33:43 2022] GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 => generated 1662 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:33:44.681322 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-7481148e-8b6b-47d6-88c5-fa3aa9176522 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:33:44.681963 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-7481148e-8b6b-47d6-88c5-fa3aa9176522 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8b9ef09-4309-4fb4-86c8-1f7499c44e75] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:33:44.688442 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-7481148e-8b6b-47d6-88c5-fa3aa9176522 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:44.688930 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-7481148e-8b6b-47d6-88c5-fa3aa9176522 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:44.689697 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-7481148e-8b6b-47d6-88c5-fa3aa9176522 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:44.690139 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-7481148e-8b6b-47d6-88c5-fa3aa9176522 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:44.819688 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-7481148e-8b6b-47d6-88c5-fa3aa9176522 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:33:44.827706 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-7481148e-8b6b-47d6-88c5-fa3aa9176522 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75" status: 200 len: 1716 microversion: 2.1 time: 0.150807 Jun 07 09:33:44.828285 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 323/644] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:33:44 2022] GET /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75 => generated 1716 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:33:44.851221 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-16c1b82b-732f-4473-8f64-19e58dd9c52c tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:33:44.851838 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-16c1b82b-732f-4473-8f64-19e58dd9c52c tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:33:44.858803 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-16c1b82b-732f-4473-8f64-19e58dd9c52c tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:44.859246 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-16c1b82b-732f-4473-8f64-19e58dd9c52c tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:44.860013 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-16c1b82b-732f-4473-8f64-19e58dd9c52c tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:44.860446 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-16c1b82b-732f-4473-8f64-19e58dd9c52c tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:44.888543 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-3460c5ec-6a3e-4d47-adf4-da9f766cc1a4 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:33:44.888543 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-3460c5ec-6a3e-4d47-adf4-da9f766cc1a4 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8b9ef09-4309-4fb4-86c8-1f7499c44e75] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:33:44.893444 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-3460c5ec-6a3e-4d47-adf4-da9f766cc1a4 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:44.893892 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-3460c5ec-6a3e-4d47-adf4-da9f766cc1a4 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:44.894660 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-3460c5ec-6a3e-4d47-adf4-da9f766cc1a4 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:44.895099 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-3460c5ec-6a3e-4d47-adf4-da9f766cc1a4 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:44.995239 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.wsgi [None req-3460c5ec-6a3e-4d47-adf4-da9f766cc1a4 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] HTTP exception thrown: Cannot 'detach_volume' instance a8b9ef09-4309-4fb4-86c8-1f7499c44e75 while it is in vm_state rescued Jun 07 09:33:44.996920 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-3460c5ec-6a3e-4d47-adf4-da9f766cc1a4 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Request method failure captured: Jun 07 09:33:44.996920 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: request: DELETE /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75/os-volume_attachments/3bbd6c72-6020-44c6-86cf-220d349a1e1e HTTP/1.1 Jun 07 09:33:44.996920 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Accept: application/json Jun 07 09:33:44.996920 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Accept-Encoding: identity Jun 07 09:33:44.996920 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Connection: close Jun 07 09:33:44.996920 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Content-Length: 0 Jun 07 09:33:44.996920 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Content-Type: application/json Jun 07 09:33:44.996920 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Host: 10.222.0.57 Jun 07 09:33:44.996920 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Openstack-System-Scope: None Jun 07 09:33:44.996920 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: User-Agent: python-urllib3/1.26.9 Jun 07 09:33:44.996920 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Auth-Token: gAAAAABinxpHQcjMxh2xTkwKSnc212e9lNltr7CXcs8JAM1TEzohifaHGcSWxwjvcbeQvYXzSUgF9FkXSPBP6LjNAbHU5v1fOXfceR_05Bkuv9pRKNML1vL97YHi3ESy-ou5_XJHettmMtf-Zn05sP8wThXG84KcMgam3l7SF6MkmFpBWtrcAjc Jun 07 09:33:44.996920 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Domain-Id: None Jun 07 09:33:44.996920 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Domain-Name: None Jun 07 09:33:44.996920 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Identity-Status: Confirmed Jun 07 09:33:44.996920 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Is-Admin-Project: True Jun 07 09:33:44.996920 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Domain-Id: default Jun 07 09:33:44.996920 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Domain-Name: Default Jun 07 09:33:44.996920 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Id: 856d592872fa47a2b628f1c3e482b2fd Jun 07 09:33:44.996920 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-738162784 Jun 07 09:33:44.996920 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Role: reader,member Jun 07 09:33:44.996920 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Roles: reader,member Jun 07 09:33:44.998583 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/856d592872fa47a2b628f1c3e482b2fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/856d592872fa47a2b628f1c3e482b2fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_856d592872fa47a2b628f1c3e482b2fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/856d592872fa47a2b628f1c3e482b2fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 07 09:33:44.998583 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Tenant: tempest-ServerRescueNegativeTestJSON-738162784 Jun 07 09:33:44.998583 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Tenant-Id: 856d592872fa47a2b628f1c3e482b2fd Jun 07 09:33:44.998583 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-738162784 Jun 07 09:33:44.998583 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User: tempest-ServerRescueNegativeTestJSON-738162784-project Jun 07 09:33:44.998583 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Domain-Id: default Jun 07 09:33:44.998583 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Domain-Name: Default Jun 07 09:33:44.998583 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Id: 75f6d2e28f024875bda0b20f751bdf0d Jun 07 09:33:44.998583 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Name: tempest-ServerRescueNegativeTestJSON-738162784-project Jun 07 09:33:44.998583 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: method: > Jun 07 09:33:44.998583 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: exception: Cannot 'detach_volume' instance a8b9ef09-4309-4fb4-86c8-1f7499c44e75 while it is in vm_state rescued Jun 07 09:33:44.999317 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: action_args: {'server_id': 'a8b9ef09-4309-4fb4-86c8-1f7499c44e75', 'id': '3bbd6c72-6020-44c6-86cf-220d349a1e1e'} Jun 07 09:33:44.999317 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 09:33:44.999317 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:33:44.999317 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 07 09:33:44.999317 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 07 09:33:44.999317 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 07 09:33:44.999317 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 07 09:33:44.999317 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 07 09:33:44.999317 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 07 09:33:44.999317 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a8b9ef09-4309-4fb4-86c8-1f7499c44e75 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 07 09:33:44.999317 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:33:44.999317 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:33:44.999317 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:33:44.999317 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:33:44.999317 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:33:44.999317 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:33:44.999317 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 09:33:44.999317 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 09:33:44.999317 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 09:33:44.999317 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 09:33:45.006964 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 07 09:33:45.006964 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 07 09:33:45.006964 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 07 09:33:45.006964 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 07 09:33:45.006964 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance a8b9ef09-4309-4fb4-86c8-1f7499c44e75 while it is in vm_state rescued Jun 07 09:33:45.006964 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:33:45.006964 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:33:45.006964 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:33:45.006964 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:33:45.006964 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:33:45.006964 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:33:45.006964 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 09:33:45.006964 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 09:33:45.006964 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance a8b9ef09-4309-4fb4-86c8-1f7499c44e75 while it is in vm_state rescued Jun 07 09:33:45.006964 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:33:45.008312 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-16c1b82b-732f-4473-8f64-19e58dd9c52c tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0346f4e3855142059983083e71c2c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c21b1cbbd604d6d9c97ab7c3c788f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:33:45.008407 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-3460c5ec-6a3e-4d47-adf4-da9f766cc1a4 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Returning 409 to user: Cannot 'detach_volume' instance a8b9ef09-4309-4fb4-86c8-1f7499c44e75 while it is in vm_state rescued {{(pid=118740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 09:33:45.008407 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-3460c5ec-6a3e-4d47-adf4-da9f766cc1a4 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "DELETE /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75/os-volume_attachments/3bbd6c72-6020-44c6-86cf-220d349a1e1e" status: 409 len: 152 microversion: 2.1 time: 0.117112 Jun 07 09:33:45.008407 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 324/645] 10.222.0.57 () {58 vars in 1415 bytes} [Tue Jun 7 09:33:44 2022] DELETE /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75/os-volume_attachments/3bbd6c72-6020-44c6-86cf-220d349a1e1e => generated 152 bytes in 118 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jun 07 09:33:45.008652 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-16c1b82b-732f-4473-8f64-19e58dd9c52c tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25" status: 200 len: 1666 microversion: 2.1 time: 0.158047 Jun 07 09:33:45.008652 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 322/646] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:33:44 2022] GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 => generated 1666 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:33:45.022775 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-9e511a76-b57f-40e8-9a18-4b9aef7c7e04 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:33:45.023228 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-9e511a76-b57f-40e8-9a18-4b9aef7c7e04 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8b9ef09-4309-4fb4-86c8-1f7499c44e75] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:33:45.029579 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-9e511a76-b57f-40e8-9a18-4b9aef7c7e04 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:45.030032 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-9e511a76-b57f-40e8-9a18-4b9aef7c7e04 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:45.030800 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-9e511a76-b57f-40e8-9a18-4b9aef7c7e04 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:45.031242 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-9e511a76-b57f-40e8-9a18-4b9aef7c7e04 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:45.246571 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-9e511a76-b57f-40e8-9a18-4b9aef7c7e04 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "POST /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75/action" status: 202 len: 0 microversion: 2.1 time: 0.227563 Jun 07 09:33:45.247198 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 325/647] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Jun 7 09:33:45 2022] POST /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75/action => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 09:33:45.255443 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-391c0a83-a58f-40f8-abd4-c65c5e5a15d8 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:33:45.256291 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-391c0a83-a58f-40f8-abd4-c65c5e5a15d8 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8b9ef09-4309-4fb4-86c8-1f7499c44e75] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:33:45.262394 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-391c0a83-a58f-40f8-abd4-c65c5e5a15d8 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:45.262848 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-391c0a83-a58f-40f8-abd4-c65c5e5a15d8 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:45.263607 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-391c0a83-a58f-40f8-abd4-c65c5e5a15d8 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:45.264047 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-391c0a83-a58f-40f8-abd4-c65c5e5a15d8 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:45.398282 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-391c0a83-a58f-40f8-abd4-c65c5e5a15d8 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:33:45.407379 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-391c0a83-a58f-40f8-abd4-c65c5e5a15d8 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75" status: 200 len: 1724 microversion: 2.1 time: 0.155785 Jun 07 09:33:45.407963 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 323/648] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:33:45 2022] GET /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:33:46.425540 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-9537c364-ecf5-47c0-8c08-f07d79b51dcc tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:33:46.426238 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-9537c364-ecf5-47c0-8c08-f07d79b51dcc tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8b9ef09-4309-4fb4-86c8-1f7499c44e75] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:33:46.433126 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-9537c364-ecf5-47c0-8c08-f07d79b51dcc tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:46.433575 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-9537c364-ecf5-47c0-8c08-f07d79b51dcc tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:46.434330 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-9537c364-ecf5-47c0-8c08-f07d79b51dcc tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:46.434773 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-9537c364-ecf5-47c0-8c08-f07d79b51dcc tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:46.567308 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-9537c364-ecf5-47c0-8c08-f07d79b51dcc tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:33:46.575306 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-9537c364-ecf5-47c0-8c08-f07d79b51dcc tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75" status: 200 len: 1724 microversion: 2.1 time: 0.154587 Jun 07 09:33:46.575873 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 326/649] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:33:46 2022] GET /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:33:46.729157 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 09:33:46.729371 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Tue Jun 7 09:33:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 09:33:47.593242 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-2e2ac3f5-2104-442c-998c-146783e3b167 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:33:47.593831 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-2e2ac3f5-2104-442c-998c-146783e3b167 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8b9ef09-4309-4fb4-86c8-1f7499c44e75] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:33:47.595653 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writing DB stats nova_cell0:SELECT=4 {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:33:47.600472 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-2e2ac3f5-2104-442c-998c-146783e3b167 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:47.600966 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-2e2ac3f5-2104-442c-998c-146783e3b167 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:47.601711 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-2e2ac3f5-2104-442c-998c-146783e3b167 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:47.602140 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-2e2ac3f5-2104-442c-998c-146783e3b167 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:47.741916 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-2e2ac3f5-2104-442c-998c-146783e3b167 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:33:47.755057 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-2e2ac3f5-2104-442c-998c-146783e3b167 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75" status: 200 len: 1724 microversion: 2.1 time: 0.160828 Jun 07 09:33:47.755057 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 324/650] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:33:47 2022] GET /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:33:48.770739 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-9b8a74ff-d170-4bd5-87e3-790dc3699165 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:33:48.771352 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-9b8a74ff-d170-4bd5-87e3-790dc3699165 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8b9ef09-4309-4fb4-86c8-1f7499c44e75] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:33:48.773757 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writing DB stats nova_api:SELECT=42 {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:33:48.778433 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-9b8a74ff-d170-4bd5-87e3-790dc3699165 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:48.778879 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-9b8a74ff-d170-4bd5-87e3-790dc3699165 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:48.779632 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-9b8a74ff-d170-4bd5-87e3-790dc3699165 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:48.780063 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-9b8a74ff-d170-4bd5-87e3-790dc3699165 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:48.919715 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-9b8a74ff-d170-4bd5-87e3-790dc3699165 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:33:48.928551 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-9b8a74ff-d170-4bd5-87e3-790dc3699165 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75" status: 200 len: 1724 microversion: 2.1 time: 0.161668 Jun 07 09:33:48.929132 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 327/651] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:33:48 2022] GET /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:33:49.945619 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-6c705664-20d2-4e13-98df-de6e39e331c7 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:33:49.946241 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-6c705664-20d2-4e13-98df-de6e39e331c7 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8b9ef09-4309-4fb4-86c8-1f7499c44e75] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:33:49.953226 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-6c705664-20d2-4e13-98df-de6e39e331c7 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:49.953667 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-6c705664-20d2-4e13-98df-de6e39e331c7 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:49.954460 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-6c705664-20d2-4e13-98df-de6e39e331c7 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:49.954904 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-6c705664-20d2-4e13-98df-de6e39e331c7 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:50.083092 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-6c705664-20d2-4e13-98df-de6e39e331c7 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:33:50.093502 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-6c705664-20d2-4e13-98df-de6e39e331c7 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75" status: 200 len: 1730 microversion: 2.1 time: 0.151657 Jun 07 09:33:50.094082 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 325/652] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:33:49 2022] GET /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:33:50.112165 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-86283bf3-75dd-4840-8fe2-d5a264efa2c8 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:33:50.112801 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-86283bf3-75dd-4840-8fe2-d5a264efa2c8 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8b9ef09-4309-4fb4-86c8-1f7499c44e75] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:33:50.121721 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-86283bf3-75dd-4840-8fe2-d5a264efa2c8 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:50.122180 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-86283bf3-75dd-4840-8fe2-d5a264efa2c8 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:50.122982 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-86283bf3-75dd-4840-8fe2-d5a264efa2c8 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:50.123422 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-86283bf3-75dd-4840-8fe2-d5a264efa2c8 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:50.199732 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-86283bf3-75dd-4840-8fe2-d5a264efa2c8 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092793 Jun 07 09:33:50.200312 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 328/653] 10.222.0.57 () {58 vars in 1274 bytes} [Tue Jun 7 09:33:50 2022] GET /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:33:51.411809 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [req-4a3c516e-c461-4e93-9472-c028f125d203 req-2fa6a35b-7ddc-4459-a931-4640d891cde6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8b9ef09-4309-4fb4-86c8-1f7499c44e75", "tag": "bb463c81-6e35-47ee-93de-84862189b305"}]} {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:33:51.420020 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [req-4a3c516e-c461-4e93-9472-c028f125d203 req-2fa6a35b-7ddc-4459-a931-4640d891cde6 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:51.420734 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [req-4a3c516e-c461-4e93-9472-c028f125d203 req-2fa6a35b-7ddc-4459-a931-4640d891cde6 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:51.431954 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.compute.server_external_events [req-4a3c516e-c461-4e93-9472-c028f125d203 req-2fa6a35b-7ddc-4459-a931-4640d891cde6 service nova] Creating event network-changed:bb463c81-6e35-47ee-93de-84862189b305 for instance a8b9ef09-4309-4fb4-86c8-1f7499c44e75 on hv-cinder-83699 Jun 07 09:33:51.438238 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [req-4a3c516e-c461-4e93-9472-c028f125d203 req-2fa6a35b-7ddc-4459-a931-4640d891cde6 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030052 Jun 07 09:33:51.438838 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 326/654] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Jun 7 09:33:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:33:53.453765 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [req-758d777d-423e-4f7f-804a-89ff68c06553 req-eaf49830-6bdf-454f-9bf9-5e30718c6d9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8b9ef09-4309-4fb4-86c8-1f7499c44e75", "tag": "bb463c81-6e35-47ee-93de-84862189b305"}]} {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:33:53.461707 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [req-758d777d-423e-4f7f-804a-89ff68c06553 req-eaf49830-6bdf-454f-9bf9-5e30718c6d9a service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:33:53.462145 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [req-758d777d-423e-4f7f-804a-89ff68c06553 req-eaf49830-6bdf-454f-9bf9-5e30718c6d9a service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:33:53.465744 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:33:53.472703 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.compute.server_external_events [req-758d777d-423e-4f7f-804a-89ff68c06553 req-eaf49830-6bdf-454f-9bf9-5e30718c6d9a service nova] Creating event network-changed:bb463c81-6e35-47ee-93de-84862189b305 for instance a8b9ef09-4309-4fb4-86c8-1f7499c44e75 on hv-cinder-83699 Jun 07 09:33:53.477571 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [req-758d777d-423e-4f7f-804a-89ff68c06553 req-eaf49830-6bdf-454f-9bf9-5e30718c6d9a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028180 Jun 07 09:33:53.484436 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 329/655] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Jun 7 09:33:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:34:03.445768 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writing DB stats nova_api:SELECT=11 {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:34:03.446520 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writing DB stats nova_cell1:SELECT=39 {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:34:03.450646 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-8e78180d-fb79-4b0a-b7fc-0f30000c7eb9 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1013959522", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2083521930", "security_groups": [{"name": "tempest-secgroup-smoke-956942239"}], "networks": [{"uuid": "be1d661b-71e8-4e62-9b3c-e9a150539a57"}], "block_device_mapping_v2": [{"uuid": "3449da80-eeb3-4f23-8de4-407db0491ff1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:34:03.564245 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.network.neutron [None req-8e78180d-fb79-4b0a-b7fc-0f30000c7eb9 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] validate_networks() for [('be1d661b-71e8-4e62-9b3c-e9a150539a57', None, None, None, None, None)] {{(pid=118741) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 09:34:03.956987 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.virt.hardware [None req-8e78180d-fb79-4b0a-b7fc-0f30000c7eb9 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Flavor limits 0:0:0 {{(pid=118741) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 09:34:03.957414 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.virt.hardware [None req-8e78180d-fb79-4b0a-b7fc-0f30000c7eb9 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Image limits 0:0:0 {{(pid=118741) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 09:34:03.957890 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.virt.hardware [None req-8e78180d-fb79-4b0a-b7fc-0f30000c7eb9 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Flavor pref 0:0:0 {{(pid=118741) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 09:34:03.958297 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.virt.hardware [None req-8e78180d-fb79-4b0a-b7fc-0f30000c7eb9 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Image pref 0:0:0 {{(pid=118741) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 09:34:03.958703 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.virt.hardware [None req-8e78180d-fb79-4b0a-b7fc-0f30000c7eb9 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118741) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 09:34:03.968035 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-8e78180d-fb79-4b0a-b7fc-0f30000c7eb9 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:03.968483 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-8e78180d-fb79-4b0a-b7fc-0f30000c7eb9 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:03.969313 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-8e78180d-fb79-4b0a-b7fc-0f30000c7eb9 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:03.969752 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-8e78180d-fb79-4b0a-b7fc-0f30000c7eb9 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:03.987253 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.quota [None req-8e78180d-fb79-4b0a-b7fc-0f30000c7eb9 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Getting quotas for project ae0e917f30d3430bb088ca3d0afe1a02. Resources: {'instances', 'cores', 'ram'} {{(pid=118741) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 09:34:03.991276 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.quota [None req-8e78180d-fb79-4b0a-b7fc-0f30000c7eb9 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Getting quotas for user 9db3cd25f4c94640854677709d10ccbe and project ae0e917f30d3430bb088ca3d0afe1a02. Resources: {'instances', 'cores', 'ram'} {{(pid=118741) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 09:34:04.047989 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-8e78180d-fb79-4b0a-b7fc-0f30000c7eb9 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Going to run 1 instances... {{(pid=118741) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 09:34:04.050205 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-8e78180d-fb79-4b0a-b7fc-0f30000c7eb9 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] [instance: dd2acb94-efe3-4c28-b597-21b0cfa1f27d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3449da80-eeb3-4f23-8de4-407db0491ff1',volume_size=None,volume_type=None)] {{(pid=118741) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 09:34:04.415569 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-8e78180d-fb79-4b0a-b7fc-0f30000c7eb9 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.970843 Jun 07 09:34:04.416209 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 327/656] 10.222.0.57 () {60 vars in 1146 bytes} [Tue Jun 7 09:34:03 2022] POST /compute/v2.1/servers => generated 405 bytes in 972 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 09:34:04.425272 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writing DB stats nova_api:SELECT=5 {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:34:04.429773 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-1f6c071e-b94b-4ebd-ac20-0a328eda6921 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:34:04.430480 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-1f6c071e-b94b-4ebd-ac20-0a328eda6921 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] [instance: dd2acb94-efe3-4c28-b597-21b0cfa1f27d] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:34:04.486389 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-1f6c071e-b94b-4ebd-ac20-0a328eda6921 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db3cd25f4c94640854677709d10ccbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0e917f30d3430bb088ca3d0afe1a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:04.493012 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-1f6c071e-b94b-4ebd-ac20-0a328eda6921 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] 10.222.0.57 "GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d" status: 200 len: 1089 microversion: 2.1 time: 0.069605 Jun 07 09:34:04.494018 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 330/657] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:34:04 2022] GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d => generated 1089 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:34:04.977603 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-f860df7b-7166-4375-918c-7a1153a02c72 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:34:04.978114 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-f860df7b-7166-4375-918c-7a1153a02c72 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 0aeeca04-2158-46a0-aabc-80438e18044d] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:34:04.984788 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-f860df7b-7166-4375-918c-7a1153a02c72 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:04.985236 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-f860df7b-7166-4375-918c-7a1153a02c72 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:04.985994 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-f860df7b-7166-4375-918c-7a1153a02c72 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:04.986429 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-f860df7b-7166-4375-918c-7a1153a02c72 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:05.009062 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-f860df7b-7166-4375-918c-7a1153a02c72 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/0aeeca04-2158-46a0-aabc-80438e18044d/ips" status: 200 len: 149 microversion: 2.1 time: 0.139015 Jun 07 09:34:05.009613 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 328/658] 10.222.0.57 () {58 vars in 1247 bytes} [Tue Jun 7 09:34:04 2022] GET /compute/v2.1/servers/0aeeca04-2158-46a0-aabc-80438e18044d/ips => generated 149 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:34:05.021180 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-c8bc2cb4-bb4d-4c63-b373-fff18d962c53 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d617ee6a-48c2-4f3a-8663-af9949cbeede"}} {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:34:05.033873 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-c8bc2cb4-bb4d-4c63-b373-fff18d962c53 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 0aeeca04-2158-46a0-aabc-80438e18044d] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:34:05.033873 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-c8bc2cb4-bb4d-4c63-b373-fff18d962c53 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:05.033873 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-c8bc2cb4-bb4d-4c63-b373-fff18d962c53 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:05.033873 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-c8bc2cb4-bb4d-4c63-b373-fff18d962c53 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:05.034281 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-c8bc2cb4-bb4d-4c63-b373-fff18d962c53 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:05.111533 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.wsgi [None req-c8bc2cb4-bb4d-4c63-b373-fff18d962c53 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] HTTP exception thrown: Invalid volume: volume d617ee6a-48c2-4f3a-8663-af9949cbeede is already attached to instances: 0e41026b-9a96-47df-a158-d8ea485025bd Jun 07 09:34:05.115418 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-c8bc2cb4-bb4d-4c63-b373-fff18d962c53 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Request method failure captured: Jun 07 09:34:05.115418 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: request: POST /compute/v2.1/servers/0aeeca04-2158-46a0-aabc-80438e18044d/os-volume_attachments HTTP/1.1 Jun 07 09:34:05.115418 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Accept: application/json Jun 07 09:34:05.115418 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Accept-Encoding: identity Jun 07 09:34:05.115418 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Connection: close Jun 07 09:34:05.115418 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Content-Length: 74 Jun 07 09:34:05.115418 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Content-Type: application/json Jun 07 09:34:05.115418 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Host: 10.222.0.57 Jun 07 09:34:05.115418 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Openstack-System-Scope: None Jun 07 09:34:05.115418 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: User-Agent: python-urllib3/1.26.9 Jun 07 09:34:05.115418 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Auth-Token: gAAAAABinxpC12ZwKTW7QgnAffZ7E-ugoEXrTCPY3mQwE3_vl9PU9oHTK85PZ0XjIngREK5HYB-lK6ouZq5luxAqHs--1L8FlbsFi6dx2RXjuHSwD2ZGE9RoKs0Rdw_R-iFZYNlQhLI_1L8kAsNT9zgLS2ggWur5AvuhEXFMSEICdPE44y32YVk Jun 07 09:34:05.115418 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Domain-Id: None Jun 07 09:34:05.115418 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Domain-Name: None Jun 07 09:34:05.115418 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Identity-Status: Confirmed Jun 07 09:34:05.115418 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Is-Admin-Project: True Jun 07 09:34:05.115418 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Domain-Id: default Jun 07 09:34:05.115418 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Domain-Name: Default Jun 07 09:34:05.115418 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Id: 50189b9cf3b145ba84495af8db63c41b Jun 07 09:34:05.115418 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Name: tempest-AttachVolumeNegativeTest-238843557 Jun 07 09:34:05.115418 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Role: reader,member Jun 07 09:34:05.115418 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Roles: reader,member Jun 07 09:34:05.116998 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/50189b9cf3b145ba84495af8db63c41b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/50189b9cf3b145ba84495af8db63c41b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_50189b9cf3b145ba84495af8db63c41b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/50189b9cf3b145ba84495af8db63c41b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 07 09:34:05.116998 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Tenant: tempest-AttachVolumeNegativeTest-238843557 Jun 07 09:34:05.116998 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Tenant-Id: 50189b9cf3b145ba84495af8db63c41b Jun 07 09:34:05.116998 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-238843557 Jun 07 09:34:05.116998 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User: tempest-AttachVolumeNegativeTest-238843557-project Jun 07 09:34:05.116998 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Domain-Id: default Jun 07 09:34:05.116998 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Domain-Name: Default Jun 07 09:34:05.116998 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Id: 2f32356bb0bd4234ba817db581b62aad Jun 07 09:34:05.116998 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Name: tempest-AttachVolumeNegativeTest-238843557-project Jun 07 09:34:05.116998 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Jun 07 09:34:05.116998 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: {"volumeAttachment": {"volumeId": "d617ee6a-48c2-4f3a-8663-af9949cbeede"}} Jun 07 09:34:05.116998 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: method: > Jun 07 09:34:05.118065 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: exception: Invalid volume: volume d617ee6a-48c2-4f3a-8663-af9949cbeede is already attached to instances: 0e41026b-9a96-47df-a158-d8ea485025bd Jun 07 09:34:05.118065 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: action_args: {'server_id': '0aeeca04-2158-46a0-aabc-80438e18044d', 'body': {'volumeAttachment': {'volumeId': 'd617ee6a-48c2-4f3a-8663-af9949cbeede'}}} Jun 07 09:34:05.118065 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 09:34:05.118065 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:34:05.118065 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 07 09:34:05.118065 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 07 09:34:05.118065 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 07 09:34:05.118065 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 07 09:34:05.118065 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 07 09:34:05.118065 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 07 09:34:05.118065 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 07 09:34:05.118065 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 07 09:34:05.118065 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 07 09:34:05.118065 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 07 09:34:05.118065 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume d617ee6a-48c2-4f3a-8663-af9949cbeede is already attached to instances: 0e41026b-9a96-47df-a158-d8ea485025bd Jun 07 09:34:05.118065 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:34:05.118065 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:34:05.118065 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:34:05.118065 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:34:05.119499 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:34:05.119499 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:34:05.119499 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 09:34:05.119499 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 09:34:05.119499 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 09:34:05.119499 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 09:34:05.119499 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 07 09:34:05.119499 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 09:34:05.119499 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 07 09:34:05.119499 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 09:34:05.119499 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 07 09:34:05.119499 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 09:34:05.119499 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 07 09:34:05.119499 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 07 09:34:05.119499 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume d617ee6a-48c2-4f3a-8663-af9949cbeede is already attached to instances: 0e41026b-9a96-47df-a158-d8ea485025bd Jun 07 09:34:05.119499 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:34:05.119499 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:34:05.119499 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:34:05.119499 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:34:05.119499 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:34:05.121091 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:34:05.121091 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 09:34:05.121091 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 09:34:05.121091 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume d617ee6a-48c2-4f3a-8663-af9949cbeede is already attached to instances: 0e41026b-9a96-47df-a158-d8ea485025bd Jun 07 09:34:05.121091 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:34:05.121091 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-c8bc2cb4-bb4d-4c63-b373-fff18d962c53 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Returning 400 to user: Invalid volume: volume d617ee6a-48c2-4f3a-8663-af9949cbeede is already attached to instances: 0e41026b-9a96-47df-a158-d8ea485025bd {{(pid=118740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 09:34:05.121091 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-c8bc2cb4-bb4d-4c63-b373-fff18d962c53 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "POST /compute/v2.1/servers/0aeeca04-2158-46a0-aabc-80438e18044d/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098210 Jun 07 09:34:05.121091 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 331/659] 10.222.0.57 () {60 vars in 1322 bytes} [Tue Jun 7 09:34:05 2022] POST /compute/v2.1/servers/0aeeca04-2158-46a0-aabc-80438e18044d/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 07 09:34:05.123890 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-416992d6-e3a0-4874-b2c2-897edcb656dc tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:34:05.124570 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-416992d6-e3a0-4874-b2c2-897edcb656dc tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 0aeeca04-2158-46a0-aabc-80438e18044d] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:34:05.131975 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-416992d6-e3a0-4874-b2c2-897edcb656dc tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:05.132374 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-416992d6-e3a0-4874-b2c2-897edcb656dc tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:05.133157 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-416992d6-e3a0-4874-b2c2-897edcb656dc tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:05.133599 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-416992d6-e3a0-4874-b2c2-897edcb656dc tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:05.159131 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-416992d6-e3a0-4874-b2c2-897edcb656dc tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 0aeeca04-2158-46a0-aabc-80438e18044d] Going to try to terminate instance {{(pid=118741) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 09:34:05.465527 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-416992d6-e3a0-4874-b2c2-897edcb656dc tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "DELETE /compute/v2.1/servers/0aeeca04-2158-46a0-aabc-80438e18044d" status: 204 len: 0 microversion: 2.1 time: 0.345377 Jun 07 09:34:05.466113 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 329/660] 10.222.0.57 () {58 vars in 1238 bytes} [Tue Jun 7 09:34:05 2022] DELETE /compute/v2.1/servers/0aeeca04-2158-46a0-aabc-80438e18044d => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 09:34:05.474337 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-3085b416-b2fb-4bea-afd1-da0200a78a6d tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:34:05.475001 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-3085b416-b2fb-4bea-afd1-da0200a78a6d tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 0aeeca04-2158-46a0-aabc-80438e18044d] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:34:05.482635 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-3085b416-b2fb-4bea-afd1-da0200a78a6d tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:05.483240 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-3085b416-b2fb-4bea-afd1-da0200a78a6d tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:05.484011 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-3085b416-b2fb-4bea-afd1-da0200a78a6d tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:05.484451 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-3085b416-b2fb-4bea-afd1-da0200a78a6d tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:05.511349 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-d8e8d001-6298-4ad6-911e-8f07fa06e2c2 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:34:05.512081 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-d8e8d001-6298-4ad6-911e-8f07fa06e2c2 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] [instance: dd2acb94-efe3-4c28-b597-21b0cfa1f27d] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:34:05.520415 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-d8e8d001-6298-4ad6-911e-8f07fa06e2c2 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:05.521228 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-d8e8d001-6298-4ad6-911e-8f07fa06e2c2 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:05.522062 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-d8e8d001-6298-4ad6-911e-8f07fa06e2c2 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:05.522501 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-d8e8d001-6298-4ad6-911e-8f07fa06e2c2 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:05.591181 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-d8e8d001-6298-4ad6-911e-8f07fa06e2c2 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db3cd25f4c94640854677709d10ccbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0e917f30d3430bb088ca3d0afe1a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:05.599188 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-d8e8d001-6298-4ad6-911e-8f07fa06e2c2 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] 10.222.0.57 "GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d" status: 200 len: 1139 microversion: 2.1 time: 0.092340 Jun 07 09:34:05.599756 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 330/661] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:34:05 2022] GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d => generated 1139 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:34:05.621326 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-3085b416-b2fb-4bea-afd1-da0200a78a6d tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:05.629630 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-3085b416-b2fb-4bea-afd1-da0200a78a6d tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/0aeeca04-2158-46a0-aabc-80438e18044d" status: 200 len: 1680 microversion: 2.1 time: 0.159210 Jun 07 09:34:05.630194 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 332/662] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:34:05 2022] GET /compute/v2.1/servers/0aeeca04-2158-46a0-aabc-80438e18044d => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:34:06.616967 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-ef9594fb-61ea-4b7d-a1e3-b5f15934d165 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:34:06.617632 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-ef9594fb-61ea-4b7d-a1e3-b5f15934d165 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] [instance: dd2acb94-efe3-4c28-b597-21b0cfa1f27d] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:34:06.624237 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-ef9594fb-61ea-4b7d-a1e3-b5f15934d165 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:06.624719 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-ef9594fb-61ea-4b7d-a1e3-b5f15934d165 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:06.625476 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-ef9594fb-61ea-4b7d-a1e3-b5f15934d165 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:06.625909 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-ef9594fb-61ea-4b7d-a1e3-b5f15934d165 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:06.647057 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-968d1214-f1f5-4d40-b9de-cab66e9e6a0e tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:34:06.647665 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-968d1214-f1f5-4d40-b9de-cab66e9e6a0e tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 0aeeca04-2158-46a0-aabc-80438e18044d] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:34:06.654038 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-968d1214-f1f5-4d40-b9de-cab66e9e6a0e tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:06.654481 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-968d1214-f1f5-4d40-b9de-cab66e9e6a0e tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:06.655299 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-968d1214-f1f5-4d40-b9de-cab66e9e6a0e tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:06.655670 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-968d1214-f1f5-4d40-b9de-cab66e9e6a0e tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:06.685005 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-ef9594fb-61ea-4b7d-a1e3-b5f15934d165 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db3cd25f4c94640854677709d10ccbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0e917f30d3430bb088ca3d0afe1a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:06.693087 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-ef9594fb-61ea-4b7d-a1e3-b5f15934d165 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] 10.222.0.57 "GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d" status: 200 len: 1139 microversion: 2.1 time: 0.079969 Jun 07 09:34:06.693663 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 331/663] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:34:06 2022] GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d => generated 1139 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:34:06.783329 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-968d1214-f1f5-4d40-b9de-cab66e9e6a0e tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:06.790626 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-968d1214-f1f5-4d40-b9de-cab66e9e6a0e tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/0aeeca04-2158-46a0-aabc-80438e18044d" status: 200 len: 1680 microversion: 2.1 time: 0.147355 Jun 07 09:34:06.791166 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 333/664] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:34:06 2022] GET /compute/v2.1/servers/0aeeca04-2158-46a0-aabc-80438e18044d => generated 1680 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:34:07.710125 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-3455140a-bfc5-4d2a-a073-c018c9ba3b5d tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:34:07.710768 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-3455140a-bfc5-4d2a-a073-c018c9ba3b5d tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] [instance: dd2acb94-efe3-4c28-b597-21b0cfa1f27d] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:34:07.717030 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-3455140a-bfc5-4d2a-a073-c018c9ba3b5d tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:07.717482 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-3455140a-bfc5-4d2a-a073-c018c9ba3b5d tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:07.718241 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-3455140a-bfc5-4d2a-a073-c018c9ba3b5d tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:07.718692 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-3455140a-bfc5-4d2a-a073-c018c9ba3b5d tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:07.780714 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-3455140a-bfc5-4d2a-a073-c018c9ba3b5d tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db3cd25f4c94640854677709d10ccbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0e917f30d3430bb088ca3d0afe1a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:07.788050 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-3455140a-bfc5-4d2a-a073-c018c9ba3b5d tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] 10.222.0.57 "GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d" status: 200 len: 1131 microversion: 2.1 time: 0.081961 Jun 07 09:34:07.791903 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 332/665] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:34:07 2022] GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d => generated 1131 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:34:07.808227 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-c7d43f2b-ccca-4833-8908-3e9350208bee tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:34:07.809016 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-c7d43f2b-ccca-4833-8908-3e9350208bee tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 0aeeca04-2158-46a0-aabc-80438e18044d] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:34:07.815955 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-c7d43f2b-ccca-4833-8908-3e9350208bee tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:07.816403 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-c7d43f2b-ccca-4833-8908-3e9350208bee tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:07.817200 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-c7d43f2b-ccca-4833-8908-3e9350208bee tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:07.817633 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-c7d43f2b-ccca-4833-8908-3e9350208bee tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:08.044805 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-c7d43f2b-ccca-4833-8908-3e9350208bee tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:08.052779 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-c7d43f2b-ccca-4833-8908-3e9350208bee tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/0aeeca04-2158-46a0-aabc-80438e18044d" status: 200 len: 1680 microversion: 2.1 time: 0.248280 Jun 07 09:34:08.053341 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 334/666] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:34:07 2022] GET /compute/v2.1/servers/0aeeca04-2158-46a0-aabc-80438e18044d => generated 1680 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:34:08.805268 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-67159538-ff09-42fa-a51f-c6678ff8a1ea tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:34:08.805909 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-67159538-ff09-42fa-a51f-c6678ff8a1ea tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] [instance: dd2acb94-efe3-4c28-b597-21b0cfa1f27d] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:34:08.812720 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-67159538-ff09-42fa-a51f-c6678ff8a1ea tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:08.813738 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-67159538-ff09-42fa-a51f-c6678ff8a1ea tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:08.814889 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-67159538-ff09-42fa-a51f-c6678ff8a1ea tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:08.815544 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-67159538-ff09-42fa-a51f-c6678ff8a1ea tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:08.931966 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [req-e5cd1004-4594-48ae-8cfb-79cc43ce2642 req-c40fe788-1b4d-4833-b1b7-5387cb2fbfe2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0aeeca04-2158-46a0-aabc-80438e18044d", "name": "network-vif-deleted", "tag": "41c93af3-c807-4234-8e0b-306a52e429c7"}]} {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:34:08.934008 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-67159538-ff09-42fa-a51f-c6678ff8a1ea tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db3cd25f4c94640854677709d10ccbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0e917f30d3430bb088ca3d0afe1a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:08.942248 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [req-e5cd1004-4594-48ae-8cfb-79cc43ce2642 req-c40fe788-1b4d-4833-b1b7-5387cb2fbfe2 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:08.942679 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [req-e5cd1004-4594-48ae-8cfb-79cc43ce2642 req-c40fe788-1b4d-4833-b1b7-5387cb2fbfe2 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:08.946316 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-67159538-ff09-42fa-a51f-c6678ff8a1ea tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] 10.222.0.57 "GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d" status: 200 len: 1205 microversion: 2.1 time: 0.144700 Jun 07 09:34:08.949713 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 333/667] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:34:08 2022] GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d => generated 1205 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:34:08.968464 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.compute.server_external_events [req-e5cd1004-4594-48ae-8cfb-79cc43ce2642 req-c40fe788-1b4d-4833-b1b7-5387cb2fbfe2 service nova] Creating event network-vif-deleted:41c93af3-c807-4234-8e0b-306a52e429c7 for instance 0aeeca04-2158-46a0-aabc-80438e18044d on hv-cinder-83699 Jun 07 09:34:08.976760 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [req-e5cd1004-4594-48ae-8cfb-79cc43ce2642 req-c40fe788-1b4d-4833-b1b7-5387cb2fbfe2 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119511 Jun 07 09:34:08.981105 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 335/668] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Jun 7 09:34:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:34:09.075878 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-8c9b8d8b-e1a5-49f5-88d0-d14a70d26057 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:34:09.079012 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-8c9b8d8b-e1a5-49f5-88d0-d14a70d26057 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 0aeeca04-2158-46a0-aabc-80438e18044d] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:34:09.086778 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-8c9b8d8b-e1a5-49f5-88d0-d14a70d26057 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:09.088266 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-8c9b8d8b-e1a5-49f5-88d0-d14a70d26057 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:09.089269 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-8c9b8d8b-e1a5-49f5-88d0-d14a70d26057 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:09.090509 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-8c9b8d8b-e1a5-49f5-88d0-d14a70d26057 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:09.191927 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-8c9b8d8b-e1a5-49f5-88d0-d14a70d26057 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:09.206435 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-8c9b8d8b-e1a5-49f5-88d0-d14a70d26057 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/0aeeca04-2158-46a0-aabc-80438e18044d" status: 200 len: 1325 microversion: 2.1 time: 0.139905 Jun 07 09:34:09.209025 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 334/669] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:34:09 2022] GET /compute/v2.1/servers/0aeeca04-2158-46a0-aabc-80438e18044d => generated 1325 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:34:09.986499 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-ac00f16f-829f-44b7-bee8-640eb4f5861c tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:34:09.987694 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-ac00f16f-829f-44b7-bee8-640eb4f5861c tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] [instance: dd2acb94-efe3-4c28-b597-21b0cfa1f27d] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:34:10.000079 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-ac00f16f-829f-44b7-bee8-640eb4f5861c tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:10.003578 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-ac00f16f-829f-44b7-bee8-640eb4f5861c tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:10.003578 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-ac00f16f-829f-44b7-bee8-640eb4f5861c tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:10.003578 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-ac00f16f-829f-44b7-bee8-640eb4f5861c tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:10.209787 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-ac00f16f-829f-44b7-bee8-640eb4f5861c tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db3cd25f4c94640854677709d10ccbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0e917f30d3430bb088ca3d0afe1a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:10.220570 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-ac00f16f-829f-44b7-bee8-640eb4f5861c tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] 10.222.0.57 "GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d" status: 200 len: 1272 microversion: 2.1 time: 0.256669 Jun 07 09:34:10.225426 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-cb8bd364-52bd-43ef-993d-fb641803cd91 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:34:10.226053 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-cb8bd364-52bd-43ef-993d-fb641803cd91 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 0aeeca04-2158-46a0-aabc-80438e18044d] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:34:10.231376 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 336/670] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:34:09 2022] GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d => generated 1272 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:34:10.234613 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-cb8bd364-52bd-43ef-993d-fb641803cd91 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:10.235071 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-cb8bd364-52bd-43ef-993d-fb641803cd91 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:10.235842 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-cb8bd364-52bd-43ef-993d-fb641803cd91 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:10.236284 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-cb8bd364-52bd-43ef-993d-fb641803cd91 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:10.270667 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-cb8bd364-52bd-43ef-993d-fb641803cd91 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:10.271121 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-cb8bd364-52bd-43ef-993d-fb641803cd91 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:10.271571 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.objects.instance [None req-cb8bd364-52bd-43ef-993d-fb641803cd91 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lazy-loading 'fault' on Instance uuid 0aeeca04-2158-46a0-aabc-80438e18044d {{(pid=118741) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 09:34:10.318554 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-cb8bd364-52bd-43ef-993d-fb641803cd91 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:10.325508 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-cb8bd364-52bd-43ef-993d-fb641803cd91 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/0aeeca04-2158-46a0-aabc-80438e18044d" status: 200 len: 1330 microversion: 2.1 time: 0.104474 Jun 07 09:34:10.326316 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 335/671] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:34:10 2022] GET /compute/v2.1/servers/0aeeca04-2158-46a0-aabc-80438e18044d => generated 1330 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:34:10.821183 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [req-c6c85606-296c-4b5e-b8e3-c4ba855d714f req-9871c5a7-2cf1-4a7a-a6f6-ed4ff96c3c8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd2acb94-efe3-4c28-b597-21b0cfa1f27d", "tag": "b980d237-cae5-40fe-89ff-abe6de093fce"}]} {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:34:10.830560 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [req-c6c85606-296c-4b5e-b8e3-c4ba855d714f req-9871c5a7-2cf1-4a7a-a6f6-ed4ff96c3c8a service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:10.831007 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [req-c6c85606-296c-4b5e-b8e3-c4ba855d714f req-9871c5a7-2cf1-4a7a-a6f6-ed4ff96c3c8a service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:10.842212 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.compute.server_external_events [req-c6c85606-296c-4b5e-b8e3-c4ba855d714f req-9871c5a7-2cf1-4a7a-a6f6-ed4ff96c3c8a service nova] Creating event network-changed:b980d237-cae5-40fe-89ff-abe6de093fce for instance dd2acb94-efe3-4c28-b597-21b0cfa1f27d on hv-cinder-83699 Jun 07 09:34:10.847513 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [req-c6c85606-296c-4b5e-b8e3-c4ba855d714f req-9871c5a7-2cf1-4a7a-a6f6-ed4ff96c3c8a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109132 Jun 07 09:34:10.848118 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 337/672] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Jun 7 09:34:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:34:11.238764 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-1cb8650f-b021-4cd7-9431-76abc99757b1 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:34:11.239388 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-1cb8650f-b021-4cd7-9431-76abc99757b1 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] [instance: dd2acb94-efe3-4c28-b597-21b0cfa1f27d] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:34:11.245824 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-1cb8650f-b021-4cd7-9431-76abc99757b1 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:11.246273 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-1cb8650f-b021-4cd7-9431-76abc99757b1 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:11.247048 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-1cb8650f-b021-4cd7-9431-76abc99757b1 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:11.247483 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-1cb8650f-b021-4cd7-9431-76abc99757b1 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:11.344322 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-56f0dbc3-0dba-489c-95f3-7de6c525a99d tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:34:11.345410 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-56f0dbc3-0dba-489c-95f3-7de6c525a99d tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 0aeeca04-2158-46a0-aabc-80438e18044d] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:34:11.352700 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-56f0dbc3-0dba-489c-95f3-7de6c525a99d tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:11.353321 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-56f0dbc3-0dba-489c-95f3-7de6c525a99d tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:11.354234 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-56f0dbc3-0dba-489c-95f3-7de6c525a99d tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:11.355178 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-56f0dbc3-0dba-489c-95f3-7de6c525a99d tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:11.369851 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.wsgi [None req-56f0dbc3-0dba-489c-95f3-7de6c525a99d tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] HTTP exception thrown: Instance 0aeeca04-2158-46a0-aabc-80438e18044d could not be found. Jun 07 09:34:11.371703 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-56f0dbc3-0dba-489c-95f3-7de6c525a99d tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Request method failure captured: Jun 07 09:34:11.371703 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: request: GET /compute/v2.1/servers/0aeeca04-2158-46a0-aabc-80438e18044d HTTP/1.1 Jun 07 09:34:11.371703 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Accept: application/json Jun 07 09:34:11.371703 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Accept-Encoding: identity Jun 07 09:34:11.371703 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Connection: close Jun 07 09:34:11.371703 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Content-Length: 0 Jun 07 09:34:11.371703 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Content-Type: application/json Jun 07 09:34:11.371703 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Host: 10.222.0.57 Jun 07 09:34:11.371703 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Openstack-System-Scope: None Jun 07 09:34:11.371703 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: User-Agent: python-urllib3/1.26.9 Jun 07 09:34:11.371703 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Auth-Token: gAAAAABinxpC12ZwKTW7QgnAffZ7E-ugoEXrTCPY3mQwE3_vl9PU9oHTK85PZ0XjIngREK5HYB-lK6ouZq5luxAqHs--1L8FlbsFi6dx2RXjuHSwD2ZGE9RoKs0Rdw_R-iFZYNlQhLI_1L8kAsNT9zgLS2ggWur5AvuhEXFMSEICdPE44y32YVk Jun 07 09:34:11.371703 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Domain-Id: None Jun 07 09:34:11.371703 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Domain-Name: None Jun 07 09:34:11.371703 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Identity-Status: Confirmed Jun 07 09:34:11.371703 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Is-Admin-Project: True Jun 07 09:34:11.371703 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Domain-Id: default Jun 07 09:34:11.371703 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Domain-Name: Default Jun 07 09:34:11.371703 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Id: 50189b9cf3b145ba84495af8db63c41b Jun 07 09:34:11.371703 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Name: tempest-AttachVolumeNegativeTest-238843557 Jun 07 09:34:11.371703 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Role: reader,member Jun 07 09:34:11.371703 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Roles: reader,member Jun 07 09:34:11.373286 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/50189b9cf3b145ba84495af8db63c41b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/50189b9cf3b145ba84495af8db63c41b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_50189b9cf3b145ba84495af8db63c41b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/50189b9cf3b145ba84495af8db63c41b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 07 09:34:11.373286 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Tenant: tempest-AttachVolumeNegativeTest-238843557 Jun 07 09:34:11.373286 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Tenant-Id: 50189b9cf3b145ba84495af8db63c41b Jun 07 09:34:11.373286 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-238843557 Jun 07 09:34:11.373286 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User: tempest-AttachVolumeNegativeTest-238843557-project Jun 07 09:34:11.373286 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Domain-Id: default Jun 07 09:34:11.373286 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Domain-Name: Default Jun 07 09:34:11.373286 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Id: 2f32356bb0bd4234ba817db581b62aad Jun 07 09:34:11.373286 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Name: tempest-AttachVolumeNegativeTest-238843557-project Jun 07 09:34:11.373286 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: method: > Jun 07 09:34:11.373286 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: exception: Instance 0aeeca04-2158-46a0-aabc-80438e18044d could not be found. Jun 07 09:34:11.373286 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: action_args: {'id': '0aeeca04-2158-46a0-aabc-80438e18044d'} Jun 07 09:34:11.374167 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 09:34:11.374167 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:34:11.374167 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 09:34:11.374167 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 09:34:11.374167 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 09:34:11.374167 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 09:34:11.374167 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 09:34:11.374167 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 09:34:11.374167 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 09:34:11.374167 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 09:34:11.374167 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0aeeca04-2158-46a0-aabc-80438e18044d could not be found. Jun 07 09:34:11.374167 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:34:11.374167 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:34:11.374167 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:34:11.374167 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:34:11.374167 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:34:11.374167 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:34:11.374167 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 09:34:11.374167 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 09:34:11.374167 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 09:34:11.375703 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 09:34:11.375703 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 09:34:11.375703 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 09:34:11.375703 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 09:34:11.375703 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 09:34:11.375703 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 09:34:11.375703 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 09:34:11.375703 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0aeeca04-2158-46a0-aabc-80438e18044d could not be found. Jun 07 09:34:11.375703 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:34:11.375703 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:34:11.375703 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:34:11.375703 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:34:11.375703 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:34:11.375703 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:34:11.375703 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 09:34:11.375703 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 09:34:11.375703 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0aeeca04-2158-46a0-aabc-80438e18044d could not be found. Jun 07 09:34:11.375703 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:34:11.377420 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-56f0dbc3-0dba-489c-95f3-7de6c525a99d tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Returning 404 to user: Instance 0aeeca04-2158-46a0-aabc-80438e18044d could not be found. {{(pid=118740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 09:34:11.377822 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-56f0dbc3-0dba-489c-95f3-7de6c525a99d tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/0aeeca04-2158-46a0-aabc-80438e18044d" status: 404 len: 111 microversion: 2.1 time: 0.037478 Jun 07 09:34:11.378488 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 338/673] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:34:11 2022] GET /compute/v2.1/servers/0aeeca04-2158-46a0-aabc-80438e18044d => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 09:34:11.387337 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-090f19a1-94be-4489-b553-4b91c396fd76 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '.version_select at 0x7f5c91db5af0>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:34:11.461965 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-090f19a1-94be-4489-b553-4b91c396fd76 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-318266299" status: 202 len: 0 microversion: 2.1 time: 0.078310 Jun 07 09:34:11.462478 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-1cb8650f-b021-4cd7-9431-76abc99757b1 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db3cd25f4c94640854677709d10ccbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0e917f30d3430bb088ca3d0afe1a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:11.463189 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 339/674] 10.222.0.57 () {58 vars in 1217 bytes} [Tue Jun 7 09:34:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-318266299 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 07 09:34:11.471342 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-1cb8650f-b021-4cd7-9431-76abc99757b1 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] 10.222.0.57 "GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d" status: 200 len: 1260 microversion: 2.1 time: 0.236970 Jun 07 09:34:11.471902 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 336/675] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:34:11 2022] GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d => generated 1260 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:34:12.491202 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-80af6ec8-a933-461d-9666-7560b966f9db tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:34:12.491815 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-80af6ec8-a933-461d-9666-7560b966f9db tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] [instance: dd2acb94-efe3-4c28-b597-21b0cfa1f27d] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:34:12.498658 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-80af6ec8-a933-461d-9666-7560b966f9db tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:12.499113 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-80af6ec8-a933-461d-9666-7560b966f9db tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:12.500550 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-80af6ec8-a933-461d-9666-7560b966f9db tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:12.501164 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-80af6ec8-a933-461d-9666-7560b966f9db tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:12.540767 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-671d4c41-d378-49ab-81db-8145d85ca8d1 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:34:12.541301 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-671d4c41-d378-49ab-81db-8145d85ca8d1 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 0e41026b-9a96-47df-a158-d8ea485025bd] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:34:12.547708 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-671d4c41-d378-49ab-81db-8145d85ca8d1 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:12.548148 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-671d4c41-d378-49ab-81db-8145d85ca8d1 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:12.548959 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-671d4c41-d378-49ab-81db-8145d85ca8d1 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:12.549386 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-671d4c41-d378-49ab-81db-8145d85ca8d1 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:12.632948 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-80af6ec8-a933-461d-9666-7560b966f9db tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db3cd25f4c94640854677709d10ccbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0e917f30d3430bb088ca3d0afe1a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:12.640345 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-80af6ec8-a933-461d-9666-7560b966f9db tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] 10.222.0.57 "GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d" status: 200 len: 1260 microversion: 2.1 time: 0.153462 Jun 07 09:34:12.640930 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 340/676] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:34:12 2022] GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:34:12.674266 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.objects.instance [None req-671d4c41-d378-49ab-81db-8145d85ca8d1 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lazy-loading 'services' on Instance uuid 0e41026b-9a96-47df-a158-d8ea485025bd {{(pid=118741) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 09:34:12.933370 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-671d4c41-d378-49ab-81db-8145d85ca8d1 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "DELETE /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd/os-volume_attachments/d617ee6a-48c2-4f3a-8663-af9949cbeede" status: 202 len: 0 microversion: 2.1 time: 0.396265 Jun 07 09:34:12.934007 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 337/677] 10.222.0.57 () {58 vars in 1415 bytes} [Tue Jun 7 09:34:12 2022] DELETE /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd/os-volume_attachments/d617ee6a-48c2-4f3a-8663-af9949cbeede => generated 0 bytes in 398 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 07 09:34:12.942429 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-ddfba06d-8f45-4229-952e-7835f7df6738 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:34:12.943449 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-ddfba06d-8f45-4229-952e-7835f7df6738 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 0e41026b-9a96-47df-a158-d8ea485025bd] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:34:12.949575 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-ddfba06d-8f45-4229-952e-7835f7df6738 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:12.949921 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-ddfba06d-8f45-4229-952e-7835f7df6738 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:12.950690 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-ddfba06d-8f45-4229-952e-7835f7df6738 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:12.951131 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-ddfba06d-8f45-4229-952e-7835f7df6738 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:12.979834 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-ddfba06d-8f45-4229-952e-7835f7df6738 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041440 Jun 07 09:34:12.980641 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 341/678] 10.222.0.57 () {58 vars in 1301 bytes} [Tue Jun 7 09:34:12 2022] GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:34:13.711053 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-b81375c1-cc92-4677-84b1-e878102622b8 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:34:13.711758 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-b81375c1-cc92-4677-84b1-e878102622b8 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] [instance: dd2acb94-efe3-4c28-b597-21b0cfa1f27d] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:34:13.719256 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b81375c1-cc92-4677-84b1-e878102622b8 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:13.719710 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b81375c1-cc92-4677-84b1-e878102622b8 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:13.720468 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b81375c1-cc92-4677-84b1-e878102622b8 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:13.720931 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b81375c1-cc92-4677-84b1-e878102622b8 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:13.977531 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writing DB stats nova_cell0:SELECT=2 {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:34:13.991562 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-39f3f251-994a-4596-a943-f6c34436ca3c tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:34:13.995198 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-39f3f251-994a-4596-a943-f6c34436ca3c tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 0e41026b-9a96-47df-a158-d8ea485025bd] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:34:13.998305 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writing DB stats nova_cell0:SELECT=6 {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:34:13.999327 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-39f3f251-994a-4596-a943-f6c34436ca3c tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:13.999780 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-39f3f251-994a-4596-a943-f6c34436ca3c tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:14.000682 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-39f3f251-994a-4596-a943-f6c34436ca3c tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:14.001126 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-39f3f251-994a-4596-a943-f6c34436ca3c tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:14.037429 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-39f3f251-994a-4596-a943-f6c34436ca3c tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049675 Jun 07 09:34:14.038719 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 342/679] 10.222.0.57 () {58 vars in 1301 bytes} [Tue Jun 7 09:34:13 2022] GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 09:34:14.113686 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-b81375c1-cc92-4677-84b1-e878102622b8 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db3cd25f4c94640854677709d10ccbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0e917f30d3430bb088ca3d0afe1a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:14.121185 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-b81375c1-cc92-4677-84b1-e878102622b8 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] 10.222.0.57 "GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d" status: 200 len: 1260 microversion: 2.1 time: 0.414361 Jun 07 09:34:14.121742 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 338/680] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:34:13 2022] GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d => generated 1260 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:34:15.048998 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-c4c161bd-faca-48e1-8b6a-d8b934f8ca15 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:34:15.050498 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-c4c161bd-faca-48e1-8b6a-d8b934f8ca15 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 0e41026b-9a96-47df-a158-d8ea485025bd] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:34:15.052803 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writing DB stats nova_cell0:SELECT=2 {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:34:15.058146 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-c4c161bd-faca-48e1-8b6a-d8b934f8ca15 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:15.058597 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-c4c161bd-faca-48e1-8b6a-d8b934f8ca15 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:15.059405 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-c4c161bd-faca-48e1-8b6a-d8b934f8ca15 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:15.059844 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-c4c161bd-faca-48e1-8b6a-d8b934f8ca15 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:15.087877 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-c4c161bd-faca-48e1-8b6a-d8b934f8ca15 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043020 Jun 07 09:34:15.092492 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 343/681] 10.222.0.57 () {58 vars in 1301 bytes} [Tue Jun 7 09:34:15 2022] GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 07 09:34:15.138030 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-d3dcdd18-61c2-44f6-8158-3e13a0034700 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:34:15.138585 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-d3dcdd18-61c2-44f6-8158-3e13a0034700 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] [instance: dd2acb94-efe3-4c28-b597-21b0cfa1f27d] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:34:15.145092 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-d3dcdd18-61c2-44f6-8158-3e13a0034700 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:15.145609 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-d3dcdd18-61c2-44f6-8158-3e13a0034700 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:15.146342 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-1d90fd26-9c7b-4b45-8295-af7b0bb67cef tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:34:15.146480 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-d3dcdd18-61c2-44f6-8158-3e13a0034700 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:15.146838 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-1d90fd26-9c7b-4b45-8295-af7b0bb67cef tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 0e41026b-9a96-47df-a158-d8ea485025bd] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:34:15.147022 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-d3dcdd18-61c2-44f6-8158-3e13a0034700 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:15.152825 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-1d90fd26-9c7b-4b45-8295-af7b0bb67cef tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:15.153280 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-1d90fd26-9c7b-4b45-8295-af7b0bb67cef tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:15.154049 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-1d90fd26-9c7b-4b45-8295-af7b0bb67cef tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:15.154554 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-1d90fd26-9c7b-4b45-8295-af7b0bb67cef tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:15.180266 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-1d90fd26-9c7b-4b45-8295-af7b0bb67cef tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 0e41026b-9a96-47df-a158-d8ea485025bd] Going to try to terminate instance {{(pid=118740) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 09:34:15.278565 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-d3dcdd18-61c2-44f6-8158-3e13a0034700 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db3cd25f4c94640854677709d10ccbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0e917f30d3430bb088ca3d0afe1a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:15.286686 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-d3dcdd18-61c2-44f6-8158-3e13a0034700 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] 10.222.0.57 "GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d" status: 200 len: 1260 microversion: 2.1 time: 0.152446 Jun 07 09:34:15.287230 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 339/682] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:34:15 2022] GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:34:15.566539 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-1d90fd26-9c7b-4b45-8295-af7b0bb67cef tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "DELETE /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd" status: 204 len: 0 microversion: 2.1 time: 0.423941 Jun 07 09:34:15.567131 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 344/683] 10.222.0.57 () {58 vars in 1238 bytes} [Tue Jun 7 09:34:15 2022] DELETE /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd => generated 0 bytes in 425 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 07 09:34:15.575207 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-2813b21b-3afb-483b-bf4e-f4ae9316ef43 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:34:15.576714 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-2813b21b-3afb-483b-bf4e-f4ae9316ef43 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 0e41026b-9a96-47df-a158-d8ea485025bd] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:34:15.582336 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-2813b21b-3afb-483b-bf4e-f4ae9316ef43 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:15.582778 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-2813b21b-3afb-483b-bf4e-f4ae9316ef43 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:15.583526 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-2813b21b-3afb-483b-bf4e-f4ae9316ef43 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:15.583956 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-2813b21b-3afb-483b-bf4e-f4ae9316ef43 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:15.715513 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-2813b21b-3afb-483b-bf4e-f4ae9316ef43 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:15.722911 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-2813b21b-3afb-483b-bf4e-f4ae9316ef43 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd" status: 200 len: 1680 microversion: 2.1 time: 0.151475 Jun 07 09:34:15.723663 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 340/684] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:34:15 2022] GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:34:16.305033 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-b43c1a81-1489-468e-b1d7-fe72b0a2515f tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:34:16.305655 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-b43c1a81-1489-468e-b1d7-fe72b0a2515f tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] [instance: dd2acb94-efe3-4c28-b597-21b0cfa1f27d] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:34:16.312114 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b43c1a81-1489-468e-b1d7-fe72b0a2515f tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:16.312572 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b43c1a81-1489-468e-b1d7-fe72b0a2515f tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:16.313366 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b43c1a81-1489-468e-b1d7-fe72b0a2515f tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:16.313808 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b43c1a81-1489-468e-b1d7-fe72b0a2515f tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:16.445117 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-b43c1a81-1489-468e-b1d7-fe72b0a2515f tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db3cd25f4c94640854677709d10ccbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0e917f30d3430bb088ca3d0afe1a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:16.452919 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-b43c1a81-1489-468e-b1d7-fe72b0a2515f tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] 10.222.0.57 "GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d" status: 200 len: 1260 microversion: 2.1 time: 0.152813 Jun 07 09:34:16.453487 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 345/685] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:34:16 2022] GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:34:16.741074 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-c01ce5be-e25b-41cd-a400-ff9c1749bf37 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:34:16.741684 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-c01ce5be-e25b-41cd-a400-ff9c1749bf37 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 0e41026b-9a96-47df-a158-d8ea485025bd] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:34:16.747600 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-c01ce5be-e25b-41cd-a400-ff9c1749bf37 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:16.748039 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-c01ce5be-e25b-41cd-a400-ff9c1749bf37 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:16.748886 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-c01ce5be-e25b-41cd-a400-ff9c1749bf37 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:16.749317 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-c01ce5be-e25b-41cd-a400-ff9c1749bf37 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:16.874045 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-c01ce5be-e25b-41cd-a400-ff9c1749bf37 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:16.877404 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:34:16.881901 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-c01ce5be-e25b-41cd-a400-ff9c1749bf37 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd" status: 200 len: 1680 microversion: 2.1 time: 0.145289 Jun 07 09:34:16.882467 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 341/686] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:34:16 2022] GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd => generated 1680 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:34:17.471389 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-b22b74e6-6892-4060-a0e4-1c99e77ee663 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:34:17.472571 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-b22b74e6-6892-4060-a0e4-1c99e77ee663 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] [instance: dd2acb94-efe3-4c28-b597-21b0cfa1f27d] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:34:17.479058 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b22b74e6-6892-4060-a0e4-1c99e77ee663 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:17.479518 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b22b74e6-6892-4060-a0e4-1c99e77ee663 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:17.480537 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b22b74e6-6892-4060-a0e4-1c99e77ee663 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:17.481009 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b22b74e6-6892-4060-a0e4-1c99e77ee663 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:17.611659 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-b22b74e6-6892-4060-a0e4-1c99e77ee663 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db3cd25f4c94640854677709d10ccbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0e917f30d3430bb088ca3d0afe1a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:17.619307 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-b22b74e6-6892-4060-a0e4-1c99e77ee663 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] 10.222.0.57 "GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d" status: 200 len: 1260 microversion: 2.1 time: 0.151778 Jun 07 09:34:17.619867 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 346/687] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:34:17 2022] GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:34:17.899968 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-eef80654-3a21-4402-a4e6-415eb915b881 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:34:17.900696 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-eef80654-3a21-4402-a4e6-415eb915b881 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 0e41026b-9a96-47df-a158-d8ea485025bd] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:34:17.907435 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-eef80654-3a21-4402-a4e6-415eb915b881 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:17.907927 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-eef80654-3a21-4402-a4e6-415eb915b881 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:17.908798 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-eef80654-3a21-4402-a4e6-415eb915b881 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:17.909238 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-eef80654-3a21-4402-a4e6-415eb915b881 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:18.135289 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-eef80654-3a21-4402-a4e6-415eb915b881 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:18.142900 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-eef80654-3a21-4402-a4e6-415eb915b881 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd" status: 200 len: 1680 microversion: 2.1 time: 0.246800 Jun 07 09:34:18.143460 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 342/688] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:34:17 2022] GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd => generated 1680 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:34:18.636179 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-d0deadd7-ab95-45f0-9886-a385b3dc580d tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:34:18.636820 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-d0deadd7-ab95-45f0-9886-a385b3dc580d tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] [instance: dd2acb94-efe3-4c28-b597-21b0cfa1f27d] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:34:18.646837 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-d0deadd7-ab95-45f0-9886-a385b3dc580d tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:18.647285 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-d0deadd7-ab95-45f0-9886-a385b3dc580d tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:18.648101 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-d0deadd7-ab95-45f0-9886-a385b3dc580d tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:18.648538 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-d0deadd7-ab95-45f0-9886-a385b3dc580d tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:18.779886 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-d0deadd7-ab95-45f0-9886-a385b3dc580d tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db3cd25f4c94640854677709d10ccbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0e917f30d3430bb088ca3d0afe1a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:18.787942 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-d0deadd7-ab95-45f0-9886-a385b3dc580d tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] 10.222.0.57 "GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d" status: 200 len: 1260 microversion: 2.1 time: 0.155874 Jun 07 09:34:18.796137 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 347/689] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:34:18 2022] GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:34:18.895699 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [req-7e365fb3-5118-4037-a209-fbc343caa38e req-0a5fb7c9-80d0-471a-ab8b-24cb1fc38688 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e41026b-9a96-47df-a158-d8ea485025bd", "name": "network-vif-deleted", "tag": "0f719a33-a29f-4d0f-8c3c-af19fd8fe82d"}]} {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:34:18.903684 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [req-7e365fb3-5118-4037-a209-fbc343caa38e req-0a5fb7c9-80d0-471a-ab8b-24cb1fc38688 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:18.904275 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [req-7e365fb3-5118-4037-a209-fbc343caa38e req-0a5fb7c9-80d0-471a-ab8b-24cb1fc38688 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:18.915645 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.compute.server_external_events [req-7e365fb3-5118-4037-a209-fbc343caa38e req-0a5fb7c9-80d0-471a-ab8b-24cb1fc38688 service nova] Creating event network-vif-deleted:0f719a33-a29f-4d0f-8c3c-af19fd8fe82d for instance 0e41026b-9a96-47df-a158-d8ea485025bd on hv-cinder-83699 Jun 07 09:34:18.920550 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [req-7e365fb3-5118-4037-a209-fbc343caa38e req-0a5fb7c9-80d0-471a-ab8b-24cb1fc38688 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028661 Jun 07 09:34:18.921269 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 343/690] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Jun 7 09:34:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:34:19.161466 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-cfdc3cd3-1977-4fb8-9c12-fb3bacf87f18 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:34:19.162073 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-cfdc3cd3-1977-4fb8-9c12-fb3bacf87f18 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 0e41026b-9a96-47df-a158-d8ea485025bd] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:34:19.168184 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-cfdc3cd3-1977-4fb8-9c12-fb3bacf87f18 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:19.168653 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-cfdc3cd3-1977-4fb8-9c12-fb3bacf87f18 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:19.169448 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-cfdc3cd3-1977-4fb8-9c12-fb3bacf87f18 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:19.169846 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-cfdc3cd3-1977-4fb8-9c12-fb3bacf87f18 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:19.239197 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-cfdc3cd3-1977-4fb8-9c12-fb3bacf87f18 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:19.241783 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:34:19.248242 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-cfdc3cd3-1977-4fb8-9c12-fb3bacf87f18 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd" status: 200 len: 1612 microversion: 2.1 time: 0.091138 Jun 07 09:34:19.248785 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 348/691] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:34:19 2022] GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd => generated 1612 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:34:19.806527 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-6b6309cb-1efe-4779-aec8-63198f3d5bc3 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:34:19.807239 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-6b6309cb-1efe-4779-aec8-63198f3d5bc3 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] [instance: dd2acb94-efe3-4c28-b597-21b0cfa1f27d] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:34:19.815259 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-6b6309cb-1efe-4779-aec8-63198f3d5bc3 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:19.816641 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-6b6309cb-1efe-4779-aec8-63198f3d5bc3 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:19.818192 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-6b6309cb-1efe-4779-aec8-63198f3d5bc3 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:19.818634 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-6b6309cb-1efe-4779-aec8-63198f3d5bc3 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:19.953632 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-6b6309cb-1efe-4779-aec8-63198f3d5bc3 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db3cd25f4c94640854677709d10ccbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0e917f30d3430bb088ca3d0afe1a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:19.961101 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-6b6309cb-1efe-4779-aec8-63198f3d5bc3 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] 10.222.0.57 "GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d" status: 200 len: 1260 microversion: 2.1 time: 0.158837 Jun 07 09:34:19.961670 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 344/692] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:34:19 2022] GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:34:20.265760 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-15caa3a5-aa7e-4505-a1db-972b3b351917 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:34:20.266374 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-15caa3a5-aa7e-4505-a1db-972b3b351917 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 0e41026b-9a96-47df-a158-d8ea485025bd] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:34:20.273547 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-15caa3a5-aa7e-4505-a1db-972b3b351917 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:20.273992 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-15caa3a5-aa7e-4505-a1db-972b3b351917 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:20.274744 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-15caa3a5-aa7e-4505-a1db-972b3b351917 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:20.275177 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-15caa3a5-aa7e-4505-a1db-972b3b351917 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:20.289029 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.wsgi [None req-15caa3a5-aa7e-4505-a1db-972b3b351917 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] HTTP exception thrown: Instance 0e41026b-9a96-47df-a158-d8ea485025bd could not be found. Jun 07 09:34:20.290564 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-15caa3a5-aa7e-4505-a1db-972b3b351917 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Request method failure captured: Jun 07 09:34:20.290564 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: request: GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd HTTP/1.1 Jun 07 09:34:20.290564 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Accept: application/json Jun 07 09:34:20.290564 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Accept-Encoding: identity Jun 07 09:34:20.290564 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Connection: close Jun 07 09:34:20.290564 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Content-Length: 0 Jun 07 09:34:20.290564 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Content-Type: application/json Jun 07 09:34:20.290564 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Host: 10.222.0.57 Jun 07 09:34:20.290564 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Openstack-System-Scope: None Jun 07 09:34:20.290564 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: User-Agent: python-urllib3/1.26.9 Jun 07 09:34:20.290564 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Auth-Token: gAAAAABinxpC12ZwKTW7QgnAffZ7E-ugoEXrTCPY3mQwE3_vl9PU9oHTK85PZ0XjIngREK5HYB-lK6ouZq5luxAqHs--1L8FlbsFi6dx2RXjuHSwD2ZGE9RoKs0Rdw_R-iFZYNlQhLI_1L8kAsNT9zgLS2ggWur5AvuhEXFMSEICdPE44y32YVk Jun 07 09:34:20.290564 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Domain-Id: None Jun 07 09:34:20.290564 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Domain-Name: None Jun 07 09:34:20.290564 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Identity-Status: Confirmed Jun 07 09:34:20.290564 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Is-Admin-Project: True Jun 07 09:34:20.290564 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Domain-Id: default Jun 07 09:34:20.290564 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Domain-Name: Default Jun 07 09:34:20.290564 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Id: 50189b9cf3b145ba84495af8db63c41b Jun 07 09:34:20.290564 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Name: tempest-AttachVolumeNegativeTest-238843557 Jun 07 09:34:20.290564 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Role: reader,member Jun 07 09:34:20.290564 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Roles: reader,member Jun 07 09:34:20.292095 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/50189b9cf3b145ba84495af8db63c41b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/50189b9cf3b145ba84495af8db63c41b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_50189b9cf3b145ba84495af8db63c41b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/50189b9cf3b145ba84495af8db63c41b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 07 09:34:20.292095 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Tenant: tempest-AttachVolumeNegativeTest-238843557 Jun 07 09:34:20.292095 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Tenant-Id: 50189b9cf3b145ba84495af8db63c41b Jun 07 09:34:20.292095 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-238843557 Jun 07 09:34:20.292095 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User: tempest-AttachVolumeNegativeTest-238843557-project Jun 07 09:34:20.292095 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Domain-Id: default Jun 07 09:34:20.292095 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Domain-Name: Default Jun 07 09:34:20.292095 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Id: 2f32356bb0bd4234ba817db581b62aad Jun 07 09:34:20.292095 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Name: tempest-AttachVolumeNegativeTest-238843557-project Jun 07 09:34:20.292095 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: method: > Jun 07 09:34:20.292095 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: exception: Instance 0e41026b-9a96-47df-a158-d8ea485025bd could not be found. Jun 07 09:34:20.292095 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: action_args: {'id': '0e41026b-9a96-47df-a158-d8ea485025bd'} Jun 07 09:34:20.293690 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 09:34:20.293690 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:34:20.293690 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 09:34:20.293690 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 09:34:20.293690 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 09:34:20.293690 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 09:34:20.293690 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 09:34:20.293690 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 09:34:20.293690 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 09:34:20.293690 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 09:34:20.293690 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e41026b-9a96-47df-a158-d8ea485025bd could not be found. Jun 07 09:34:20.293690 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:34:20.293690 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:34:20.293690 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:34:20.293690 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:34:20.293690 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:34:20.293690 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:34:20.293690 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 09:34:20.293690 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 09:34:20.293690 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 09:34:20.294899 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 09:34:20.294899 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 09:34:20.294899 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 09:34:20.294899 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 09:34:20.294899 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 09:34:20.294899 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 09:34:20.294899 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 09:34:20.294899 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e41026b-9a96-47df-a158-d8ea485025bd could not be found. Jun 07 09:34:20.294899 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:34:20.294899 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:34:20.294899 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:34:20.294899 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:34:20.294899 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:34:20.294899 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:34:20.294899 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 09:34:20.294899 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 09:34:20.294899 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e41026b-9a96-47df-a158-d8ea485025bd could not be found. Jun 07 09:34:20.294899 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:34:20.296122 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-15caa3a5-aa7e-4505-a1db-972b3b351917 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Returning 404 to user: Instance 0e41026b-9a96-47df-a158-d8ea485025bd could not be found. {{(pid=118740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 09:34:20.296122 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-15caa3a5-aa7e-4505-a1db-972b3b351917 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd" status: 404 len: 111 microversion: 2.1 time: 0.030277 Jun 07 09:34:20.296122 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 349/693] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:34:20 2022] GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 09:34:20.301422 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-a7ac13d7-093e-485a-a2ff-949f48241c65 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '.version_select at 0x7f5c9320cb80>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:34:20.380891 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-a7ac13d7-093e-485a-a2ff-949f48241c65 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-667598548" status: 202 len: 0 microversion: 2.1 time: 0.083868 Jun 07 09:34:20.381473 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 345/694] 10.222.0.57 () {58 vars in 1217 bytes} [Tue Jun 7 09:34:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-667598548 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 09:34:20.978240 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-63775298-f229-49e2-9f97-10ce5b926c73 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:34:20.978850 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-63775298-f229-49e2-9f97-10ce5b926c73 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] [instance: dd2acb94-efe3-4c28-b597-21b0cfa1f27d] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:34:20.985802 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-63775298-f229-49e2-9f97-10ce5b926c73 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:20.986248 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-63775298-f229-49e2-9f97-10ce5b926c73 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:20.987003 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-63775298-f229-49e2-9f97-10ce5b926c73 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:20.987436 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-63775298-f229-49e2-9f97-10ce5b926c73 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:21.182825 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-63775298-f229-49e2-9f97-10ce5b926c73 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db3cd25f4c94640854677709d10ccbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0e917f30d3430bb088ca3d0afe1a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:21.184079 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-8fafa1fb-8135-4431-9976-492375d5aab9 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Action: 'create', calling method: .version_select at 0x7f5c927fa0d0>, body: {"keypair": {"name": "tempest-keypair-1106376749", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP8Fg267axZ8KUOD/5B8LeVJUaljGCG/0OEVsylKQFXRf584G6PgHM7LN7/QWpRaxAhTMYW4EdbZDMoGnacuI0/7ReFLMV0VsY2FRdj3LCunUNscCbtGtkvEtC6cIVQJFA=="}} {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:34:21.191124 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-63775298-f229-49e2-9f97-10ce5b926c73 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] 10.222.0.57 "GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d" status: 200 len: 1260 microversion: 2.1 time: 0.216165 Jun 07 09:34:21.192123 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 350/695] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:34:20 2022] GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d => generated 1260 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:34:21.198466 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.quota [None req-8fafa1fb-8135-4431-9976-492375d5aab9 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Getting quotas for project 50189b9cf3b145ba84495af8db63c41b. Resources: {'key_pairs'} {{(pid=118741) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 09:34:21.202306 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.quota [None req-8fafa1fb-8135-4431-9976-492375d5aab9 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Getting quotas for user 2f32356bb0bd4234ba817db581b62aad and project 50189b9cf3b145ba84495af8db63c41b. Resources: {'key_pairs'} {{(pid=118741) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 09:34:21.304051 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-8fafa1fb-8135-4431-9976-492375d5aab9 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.123674 Jun 07 09:34:21.304674 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 346/696] 10.222.0.57 () {60 vars in 1158 bytes} [Tue Jun 7 09:34:21 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:34:22.208960 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-ccb7c9cc-4ef5-487c-8735-b82f5ef63258 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:34:22.209606 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-ccb7c9cc-4ef5-487c-8735-b82f5ef63258 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] [instance: dd2acb94-efe3-4c28-b597-21b0cfa1f27d] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:34:22.215921 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-ccb7c9cc-4ef5-487c-8735-b82f5ef63258 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:22.216375 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-ccb7c9cc-4ef5-487c-8735-b82f5ef63258 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:22.217187 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-ccb7c9cc-4ef5-487c-8735-b82f5ef63258 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:22.217761 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-ccb7c9cc-4ef5-487c-8735-b82f5ef63258 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:22.355053 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-ccb7c9cc-4ef5-487c-8735-b82f5ef63258 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db3cd25f4c94640854677709d10ccbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0e917f30d3430bb088ca3d0afe1a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:22.362536 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-ccb7c9cc-4ef5-487c-8735-b82f5ef63258 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] 10.222.0.57 "GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d" status: 200 len: 1260 microversion: 2.1 time: 0.158314 Jun 07 09:34:22.363089 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 351/697] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:34:22 2022] GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:34:22.829815 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [req-5efa67eb-8ef9-45ba-88a8-319ebd72e897 req-9cccd748-1f5e-4ef5-9766-c887b6bd534b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd2acb94-efe3-4c28-b597-21b0cfa1f27d", "name": "network-vif-plugged", "status": "completed", "tag": "b980d237-cae5-40fe-89ff-abe6de093fce"}]} {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:34:22.838658 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [req-5efa67eb-8ef9-45ba-88a8-319ebd72e897 req-9cccd748-1f5e-4ef5-9766-c887b6bd534b service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:22.839091 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [req-5efa67eb-8ef9-45ba-88a8-319ebd72e897 req-9cccd748-1f5e-4ef5-9766-c887b6bd534b service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:22.849436 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.compute.server_external_events [req-5efa67eb-8ef9-45ba-88a8-319ebd72e897 req-9cccd748-1f5e-4ef5-9766-c887b6bd534b service nova] Creating event network-vif-plugged:b980d237-cae5-40fe-89ff-abe6de093fce for instance dd2acb94-efe3-4c28-b597-21b0cfa1f27d on hv-cinder-83699 Jun 07 09:34:22.854122 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [req-5efa67eb-8ef9-45ba-88a8-319ebd72e897 req-9cccd748-1f5e-4ef5-9766-c887b6bd534b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082316 Jun 07 09:34:22.854966 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 347/698] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Jun 7 09:34:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:34:23.379400 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-775a724b-88e6-4fad-8011-b74007d603b3 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:34:23.380152 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-775a724b-88e6-4fad-8011-b74007d603b3 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] [instance: dd2acb94-efe3-4c28-b597-21b0cfa1f27d] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:34:23.386771 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-775a724b-88e6-4fad-8011-b74007d603b3 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:23.387223 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-775a724b-88e6-4fad-8011-b74007d603b3 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:23.387993 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-775a724b-88e6-4fad-8011-b74007d603b3 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:23.388500 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-775a724b-88e6-4fad-8011-b74007d603b3 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:23.547796 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-775a724b-88e6-4fad-8011-b74007d603b3 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db3cd25f4c94640854677709d10ccbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0e917f30d3430bb088ca3d0afe1a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:23.555530 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-775a724b-88e6-4fad-8011-b74007d603b3 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] 10.222.0.57 "GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d" status: 200 len: 1260 microversion: 2.1 time: 0.180185 Jun 07 09:34:23.556082 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 352/699] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:34:23 2022] GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d => generated 1260 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:34:23.776602 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-3dcd60de-4f9b-460c-977d-5a3f19b017d3 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-923692383", "imageRef": "8fdb0275-8c58-4c9e-a2f3-3aae3a947526", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1c3e2e81-e169-4afa-8693-c0d0a9ba7610"}], "security_groups": [{"name": "tempest-securitygroup--1961907743"}], "key_name": "tempest-keypair-1106376749", "user_data": "}} {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:34:23.875050 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.network.neutron [None req-3dcd60de-4f9b-460c-977d-5a3f19b017d3 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] validate_networks() for [('1c3e2e81-e169-4afa-8693-c0d0a9ba7610', None, None, None, None, None)] {{(pid=118741) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 09:34:24.235624 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.virt.hardware [None req-3dcd60de-4f9b-460c-977d-5a3f19b017d3 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Flavor limits 0:0:0 {{(pid=118741) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 09:34:24.236043 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.virt.hardware [None req-3dcd60de-4f9b-460c-977d-5a3f19b017d3 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Image limits 0:0:0 {{(pid=118741) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 09:34:24.236514 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.virt.hardware [None req-3dcd60de-4f9b-460c-977d-5a3f19b017d3 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Flavor pref 0:0:0 {{(pid=118741) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 09:34:24.236965 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.virt.hardware [None req-3dcd60de-4f9b-460c-977d-5a3f19b017d3 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Image pref 0:0:0 {{(pid=118741) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 09:34:24.237883 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.virt.hardware [None req-3dcd60de-4f9b-460c-977d-5a3f19b017d3 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118741) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 09:34:24.246597 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-3dcd60de-4f9b-460c-977d-5a3f19b017d3 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:24.247042 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-3dcd60de-4f9b-460c-977d-5a3f19b017d3 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:24.247831 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-3dcd60de-4f9b-460c-977d-5a3f19b017d3 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:24.248265 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-3dcd60de-4f9b-460c-977d-5a3f19b017d3 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:24.264904 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.quota [None req-3dcd60de-4f9b-460c-977d-5a3f19b017d3 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Getting quotas for project 50189b9cf3b145ba84495af8db63c41b. Resources: {'instances', 'cores', 'ram'} {{(pid=118741) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 09:34:24.268754 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.quota [None req-3dcd60de-4f9b-460c-977d-5a3f19b017d3 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Getting quotas for user 2f32356bb0bd4234ba817db581b62aad and project 50189b9cf3b145ba84495af8db63c41b. Resources: {'instances', 'cores', 'ram'} {{(pid=118741) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 09:34:24.279422 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-3dcd60de-4f9b-460c-977d-5a3f19b017d3 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Going to run 1 instances... {{(pid=118741) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 09:34:24.281769 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-3dcd60de-4f9b-460c-977d-5a3f19b017d3 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 91b69fc3-c7b5-4243-8ee9-47e76d278c8b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8fdb0275-8c58-4c9e-a2f3-3aae3a947526',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118741) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 09:34:24.419705 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-3dcd60de-4f9b-460c-977d-5a3f19b017d3 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.647599 Jun 07 09:34:24.420312 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 348/700] 10.222.0.57 () {60 vars in 1146 bytes} [Tue Jun 7 09:34:23 2022] POST /compute/v2.1/servers => generated 402 bytes in 649 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 09:34:24.430754 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-f89d5924-0338-417a-bbc4-f75cdfcc0a42 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:34:24.431362 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-f89d5924-0338-417a-bbc4-f75cdfcc0a42 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 91b69fc3-c7b5-4243-8ee9-47e76d278c8b] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:34:24.485243 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-f89d5924-0338-417a-bbc4-f75cdfcc0a42 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:24.492638 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-f89d5924-0338-417a-bbc4-f75cdfcc0a42 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/91b69fc3-c7b5-4243-8ee9-47e76d278c8b" status: 200 len: 1241 microversion: 2.1 time: 0.065780 Jun 07 09:34:24.493209 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 353/701] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:34:24 2022] GET /compute/v2.1/servers/91b69fc3-c7b5-4243-8ee9-47e76d278c8b => generated 1241 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:34:24.572432 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-4ffa91fb-721a-4b16-a89b-d1bc1e9f058c tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:34:24.573078 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-4ffa91fb-721a-4b16-a89b-d1bc1e9f058c tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] [instance: dd2acb94-efe3-4c28-b597-21b0cfa1f27d] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:34:24.579322 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-4ffa91fb-721a-4b16-a89b-d1bc1e9f058c tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:24.579774 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-4ffa91fb-721a-4b16-a89b-d1bc1e9f058c tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:24.580524 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-4ffa91fb-721a-4b16-a89b-d1bc1e9f058c tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:24.580986 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-4ffa91fb-721a-4b16-a89b-d1bc1e9f058c tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:24.713317 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-4ffa91fb-721a-4b16-a89b-d1bc1e9f058c tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db3cd25f4c94640854677709d10ccbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0e917f30d3430bb088ca3d0afe1a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:24.720427 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-4ffa91fb-721a-4b16-a89b-d1bc1e9f058c tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] 10.222.0.57 "GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d" status: 200 len: 1260 microversion: 2.1 time: 0.151799 Jun 07 09:34:24.721006 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 349/702] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:34:24 2022] GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:34:25.509576 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-bc316907-6482-432a-9e82-2b6c2acce6c2 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:34:25.510163 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-bc316907-6482-432a-9e82-2b6c2acce6c2 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 91b69fc3-c7b5-4243-8ee9-47e76d278c8b] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:34:25.517533 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-bc316907-6482-432a-9e82-2b6c2acce6c2 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:25.517982 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-bc316907-6482-432a-9e82-2b6c2acce6c2 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:25.518838 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-bc316907-6482-432a-9e82-2b6c2acce6c2 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:25.519222 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-bc316907-6482-432a-9e82-2b6c2acce6c2 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:25.580053 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-bc316907-6482-432a-9e82-2b6c2acce6c2 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:25.587642 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-bc316907-6482-432a-9e82-2b6c2acce6c2 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/91b69fc3-c7b5-4243-8ee9-47e76d278c8b" status: 200 len: 1245 microversion: 2.1 time: 0.081893 Jun 07 09:34:25.588265 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 354/703] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:34:25 2022] GET /compute/v2.1/servers/91b69fc3-c7b5-4243-8ee9-47e76d278c8b => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:34:25.739112 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-335d50fd-4038-43d6-8471-2aedbc7ba18d tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:34:25.739719 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-335d50fd-4038-43d6-8471-2aedbc7ba18d tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] [instance: dd2acb94-efe3-4c28-b597-21b0cfa1f27d] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:34:25.742888 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:34:25.746692 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-335d50fd-4038-43d6-8471-2aedbc7ba18d tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:25.747199 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-335d50fd-4038-43d6-8471-2aedbc7ba18d tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:25.747962 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-335d50fd-4038-43d6-8471-2aedbc7ba18d tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:25.748396 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-335d50fd-4038-43d6-8471-2aedbc7ba18d tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:25.889160 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-335d50fd-4038-43d6-8471-2aedbc7ba18d tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db3cd25f4c94640854677709d10ccbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0e917f30d3430bb088ca3d0afe1a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:25.892099 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-335d50fd-4038-43d6-8471-2aedbc7ba18d tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] 10.222.0.57 "GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d" status: 200 len: 1444 microversion: 2.1 time: 0.157859 Jun 07 09:34:25.892695 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 350/704] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:34:25 2022] GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d => generated 1444 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:34:25.908715 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-7329f4d8-9761-4415-9dea-d3a785f8922c tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:34:25.915485 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-7329f4d8-9761-4415-9dea-d3a785f8922c tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] [instance: dd2acb94-efe3-4c28-b597-21b0cfa1f27d] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:34:25.915985 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-7329f4d8-9761-4415-9dea-d3a785f8922c tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:25.916468 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-7329f4d8-9761-4415-9dea-d3a785f8922c tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:25.917261 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-7329f4d8-9761-4415-9dea-d3a785f8922c tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:25.917695 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-7329f4d8-9761-4415-9dea-d3a785f8922c tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:26.052234 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-7329f4d8-9761-4415-9dea-d3a785f8922c tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db3cd25f4c94640854677709d10ccbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0e917f30d3430bb088ca3d0afe1a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:26.059845 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-7329f4d8-9761-4415-9dea-d3a785f8922c tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] 10.222.0.57 "GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d" status: 200 len: 1444 microversion: 2.1 time: 0.154939 Jun 07 09:34:26.060408 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 355/705] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:34:25 2022] GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d => generated 1444 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:34:26.605975 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-869600b2-9f16-4f0f-acb0-98168da2752f tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:34:26.607433 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-869600b2-9f16-4f0f-acb0-98168da2752f tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 91b69fc3-c7b5-4243-8ee9-47e76d278c8b] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:34:26.618007 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-869600b2-9f16-4f0f-acb0-98168da2752f tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:26.620652 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-869600b2-9f16-4f0f-acb0-98168da2752f tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:26.621662 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-869600b2-9f16-4f0f-acb0-98168da2752f tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:26.627410 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-869600b2-9f16-4f0f-acb0-98168da2752f tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:26.714828 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-869600b2-9f16-4f0f-acb0-98168da2752f tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:26.733054 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-869600b2-9f16-4f0f-acb0-98168da2752f tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/91b69fc3-c7b5-4243-8ee9-47e76d278c8b" status: 200 len: 1301 microversion: 2.1 time: 0.131451 Jun 07 09:34:26.734871 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 356/706] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:34:26 2022] GET /compute/v2.1/servers/91b69fc3-c7b5-4243-8ee9-47e76d278c8b => generated 1301 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:34:26.743739 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-77a4ab58-3b71-4192-8820-fcfde906e03c tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:34:26.744928 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-77a4ab58-3b71-4192-8820-fcfde906e03c tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:34:26.752054 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-77a4ab58-3b71-4192-8820-fcfde906e03c tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:26.752964 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-77a4ab58-3b71-4192-8820-fcfde906e03c tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:26.754448 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-77a4ab58-3b71-4192-8820-fcfde906e03c tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:26.755130 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-77a4ab58-3b71-4192-8820-fcfde906e03c tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:26.786974 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-77a4ab58-3b71-4192-8820-fcfde906e03c tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2/os-volume_attachments/62a1333a-f803-4adf-9361-d1ac3f265f3f" status: 200 len: 194 microversion: 2.20 time: 0.223891 Jun 07 09:34:26.792975 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 351/707] 10.222.0.57 () {60 vars in 1453 bytes} [Tue Jun 7 09:34:26 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2/os-volume_attachments/62a1333a-f803-4adf-9361-d1ac3f265f3f => generated 194 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 09:34:26.863279 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-408e438c-ddaf-42dd-98c0-fb8ba29c37d1 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:34:26.864799 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-408e438c-ddaf-42dd-98c0-fb8ba29c37d1 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:34:26.872093 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-408e438c-ddaf-42dd-98c0-fb8ba29c37d1 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:26.872549 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-408e438c-ddaf-42dd-98c0-fb8ba29c37d1 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:26.880553 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-408e438c-ddaf-42dd-98c0-fb8ba29c37d1 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:26.881312 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-408e438c-ddaf-42dd-98c0-fb8ba29c37d1 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:26.967714 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.objects.instance [None req-408e438c-ddaf-42dd-98c0-fb8ba29c37d1 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lazy-loading 'services' on Instance uuid 102039c7-8224-43f7-9fb8-90b82968cfa2 {{(pid=118740) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 09:34:27.219430 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-408e438c-ddaf-42dd-98c0-fb8ba29c37d1 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "DELETE /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2/os-volume_attachments/62a1333a-f803-4adf-9361-d1ac3f265f3f" status: 202 len: 0 microversion: 2.20 time: 0.359969 Jun 07 09:34:27.220392 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 357/708] 10.222.0.57 () {60 vars in 1456 bytes} [Tue Jun 7 09:34:26 2022] DELETE /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2/os-volume_attachments/62a1333a-f803-4adf-9361-d1ac3f265f3f => generated 0 bytes in 362 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 07 09:34:27.229138 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-0b594366-82f7-4c61-9b57-b6ee88debf60 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:34:27.230426 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-0b594366-82f7-4c61-9b57-b6ee88debf60 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:34:27.237088 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-0b594366-82f7-4c61-9b57-b6ee88debf60 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:27.238880 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-0b594366-82f7-4c61-9b57-b6ee88debf60 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:27.240054 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-0b594366-82f7-4c61-9b57-b6ee88debf60 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:27.240702 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-0b594366-82f7-4c61-9b57-b6ee88debf60 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:27.285873 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-0b594366-82f7-4c61-9b57-b6ee88debf60 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060760 Jun 07 09:34:27.287160 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 352/709] 10.222.0.57 () {60 vars in 1342 bytes} [Tue Jun 7 09:34:27 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 07 09:34:27.752427 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-cf592c07-f234-46d0-a6eb-3f7061010dcb tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:34:27.753699 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-cf592c07-f234-46d0-a6eb-3f7061010dcb tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 91b69fc3-c7b5-4243-8ee9-47e76d278c8b] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:34:27.760893 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-cf592c07-f234-46d0-a6eb-3f7061010dcb tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:27.761462 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-cf592c07-f234-46d0-a6eb-3f7061010dcb tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:27.762322 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-cf592c07-f234-46d0-a6eb-3f7061010dcb tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:27.762833 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-cf592c07-f234-46d0-a6eb-3f7061010dcb tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:27.994183 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-cf592c07-f234-46d0-a6eb-3f7061010dcb tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:28.002067 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-cf592c07-f234-46d0-a6eb-3f7061010dcb tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/91b69fc3-c7b5-4243-8ee9-47e76d278c8b" status: 200 len: 1367 microversion: 2.1 time: 0.254436 Jun 07 09:34:28.003710 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 358/710] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:34:27 2022] GET /compute/v2.1/servers/91b69fc3-c7b5-4243-8ee9-47e76d278c8b => generated 1367 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:34:28.298083 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-c7911167-ca97-4a54-a00b-496926f15220 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:34:28.299104 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-c7911167-ca97-4a54-a00b-496926f15220 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:34:28.305533 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-c7911167-ca97-4a54-a00b-496926f15220 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:28.305975 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-c7911167-ca97-4a54-a00b-496926f15220 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:28.306717 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-c7911167-ca97-4a54-a00b-496926f15220 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:28.307149 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-c7911167-ca97-4a54-a00b-496926f15220 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:28.337132 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-c7911167-ca97-4a54-a00b-496926f15220 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042954 Jun 07 09:34:28.337693 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 353/711] 10.222.0.57 () {60 vars in 1342 bytes} [Tue Jun 7 09:34:28 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 09:34:28.696674 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [req-c9d6ed67-97bf-4679-8314-cd2c522a0bf1 req-0c630b60-1f32-400e-96c5-b07dabb77e21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91b69fc3-c7b5-4243-8ee9-47e76d278c8b", "tag": "d459ab10-7637-47b2-85a4-a5d49c5f63a8"}]} {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:34:28.705828 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [req-c9d6ed67-97bf-4679-8314-cd2c522a0bf1 req-0c630b60-1f32-400e-96c5-b07dabb77e21 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:28.714710 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [req-c9d6ed67-97bf-4679-8314-cd2c522a0bf1 req-0c630b60-1f32-400e-96c5-b07dabb77e21 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:28.722509 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.compute.server_external_events [req-c9d6ed67-97bf-4679-8314-cd2c522a0bf1 req-0c630b60-1f32-400e-96c5-b07dabb77e21 service nova] Creating event network-changed:d459ab10-7637-47b2-85a4-a5d49c5f63a8 for instance 91b69fc3-c7b5-4243-8ee9-47e76d278c8b on hv-cinder-83699 Jun 07 09:34:28.724328 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [req-6e472831-4c82-4678-96aa-4ef913a0737b req-45b8553c-1fe5-4ea6-a92f-1173e48d912a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd2acb94-efe3-4c28-b597-21b0cfa1f27d", "tag": "b980d237-cae5-40fe-89ff-abe6de093fce"}]} {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:34:28.727932 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [req-c9d6ed67-97bf-4679-8314-cd2c522a0bf1 req-0c630b60-1f32-400e-96c5-b07dabb77e21 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034794 Jun 07 09:34:28.729214 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 359/712] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Jun 7 09:34:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:34:28.738415 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [req-6e472831-4c82-4678-96aa-4ef913a0737b req-45b8553c-1fe5-4ea6-a92f-1173e48d912a service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:28.738415 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [req-6e472831-4c82-4678-96aa-4ef913a0737b req-45b8553c-1fe5-4ea6-a92f-1173e48d912a service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:28.750811 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.compute.server_external_events [req-6e472831-4c82-4678-96aa-4ef913a0737b req-45b8553c-1fe5-4ea6-a92f-1173e48d912a service nova] Creating event network-changed:b980d237-cae5-40fe-89ff-abe6de093fce for instance dd2acb94-efe3-4c28-b597-21b0cfa1f27d on hv-cinder-83699 Jun 07 09:34:28.757147 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [req-6e472831-4c82-4678-96aa-4ef913a0737b req-45b8553c-1fe5-4ea6-a92f-1173e48d912a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040088 Jun 07 09:34:28.758171 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 354/713] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Jun 7 09:34:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:34:29.020162 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-fec5755c-c5e8-4c31-8cb2-55830aec7405 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:34:29.020901 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-fec5755c-c5e8-4c31-8cb2-55830aec7405 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 91b69fc3-c7b5-4243-8ee9-47e76d278c8b] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:34:29.028642 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-fec5755c-c5e8-4c31-8cb2-55830aec7405 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:29.029105 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-fec5755c-c5e8-4c31-8cb2-55830aec7405 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:29.029889 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-fec5755c-c5e8-4c31-8cb2-55830aec7405 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:29.030331 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-fec5755c-c5e8-4c31-8cb2-55830aec7405 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:29.203736 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-fec5755c-c5e8-4c31-8cb2-55830aec7405 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:29.210301 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-fec5755c-c5e8-4c31-8cb2-55830aec7405 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/91b69fc3-c7b5-4243-8ee9-47e76d278c8b" status: 200 len: 1367 microversion: 2.1 time: 0.194598 Jun 07 09:34:29.220318 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 360/714] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:34:29 2022] GET /compute/v2.1/servers/91b69fc3-c7b5-4243-8ee9-47e76d278c8b => generated 1367 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:34:29.350113 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-9320d5fc-f1ee-44f8-85a3-75ce1470d7f0 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:34:29.352028 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-9320d5fc-f1ee-44f8-85a3-75ce1470d7f0 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:34:29.359478 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-9320d5fc-f1ee-44f8-85a3-75ce1470d7f0 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:29.360084 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-9320d5fc-f1ee-44f8-85a3-75ce1470d7f0 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:29.360958 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-9320d5fc-f1ee-44f8-85a3-75ce1470d7f0 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:29.361768 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-9320d5fc-f1ee-44f8-85a3-75ce1470d7f0 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:29.396211 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-9320d5fc-f1ee-44f8-85a3-75ce1470d7f0 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.050961 Jun 07 09:34:29.402524 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 355/715] 10.222.0.57 () {60 vars in 1342 bytes} [Tue Jun 7 09:34:29 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:34:29.470973 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-20fe44af-808a-42f5-989c-863f786f18e2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:34:29.471478 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-20fe44af-808a-42f5-989c-863f786f18e2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:34:29.478378 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-20fe44af-808a-42f5-989c-863f786f18e2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:29.478939 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-20fe44af-808a-42f5-989c-863f786f18e2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:29.479995 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-20fe44af-808a-42f5-989c-863f786f18e2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:29.480527 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-20fe44af-808a-42f5-989c-863f786f18e2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:29.507767 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-20fe44af-808a-42f5-989c-863f786f18e2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Going to try to terminate instance {{(pid=118740) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 09:34:29.966236 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-20fe44af-808a-42f5-989c-863f786f18e2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "DELETE /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 204 len: 0 microversion: 2.20 time: 0.495155 Jun 07 09:34:29.966236 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 361/716] 10.222.0.57 () {60 vars in 1279 bytes} [Tue Jun 7 09:34:29 2022] DELETE /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 07 09:34:29.971276 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-e933cd0c-de96-4660-8bb4-497f25c73463 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:34:29.971890 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-e933cd0c-de96-4660-8bb4-497f25c73463 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:34:29.978090 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-e933cd0c-de96-4660-8bb4-497f25c73463 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:29.978541 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-e933cd0c-de96-4660-8bb4-497f25c73463 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:29.979308 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-e933cd0c-de96-4660-8bb4-497f25c73463 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:29.980004 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-e933cd0c-de96-4660-8bb4-497f25c73463 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:30.107463 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-e933cd0c-de96-4660-8bb4-497f25c73463 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:30.115242 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-e933cd0c-de96-4660-8bb4-497f25c73463 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:30.116791 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-e933cd0c-de96-4660-8bb4-497f25c73463 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:30.117942 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-e933cd0c-de96-4660-8bb4-497f25c73463 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1720 microversion: 2.20 time: 0.150511 Jun 07 09:34:30.118495 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 356/717] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:34:29 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:34:30.228461 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-101327de-747b-4cea-91fe-b00eb98a0d8a tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:34:30.229416 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-101327de-747b-4cea-91fe-b00eb98a0d8a tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 91b69fc3-c7b5-4243-8ee9-47e76d278c8b] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:34:30.236208 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-101327de-747b-4cea-91fe-b00eb98a0d8a tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:30.236695 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-101327de-747b-4cea-91fe-b00eb98a0d8a tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:30.237944 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-101327de-747b-4cea-91fe-b00eb98a0d8a tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:30.238405 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-101327de-747b-4cea-91fe-b00eb98a0d8a tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:30.364113 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-101327de-747b-4cea-91fe-b00eb98a0d8a tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:30.371406 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-101327de-747b-4cea-91fe-b00eb98a0d8a tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/91b69fc3-c7b5-4243-8ee9-47e76d278c8b" status: 200 len: 1367 microversion: 2.1 time: 0.147901 Jun 07 09:34:30.371953 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 362/718] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:34:30 2022] GET /compute/v2.1/servers/91b69fc3-c7b5-4243-8ee9-47e76d278c8b => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:34:31.135915 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-d1703736-4855-40ac-8eff-ab32d8b8350d tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:34:31.136550 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-d1703736-4855-40ac-8eff-ab32d8b8350d tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:34:31.142706 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-d1703736-4855-40ac-8eff-ab32d8b8350d tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:31.143159 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-d1703736-4855-40ac-8eff-ab32d8b8350d tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:31.144462 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-d1703736-4855-40ac-8eff-ab32d8b8350d tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:31.144931 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-d1703736-4855-40ac-8eff-ab32d8b8350d tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:31.268997 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-d1703736-4855-40ac-8eff-ab32d8b8350d tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:31.276871 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-d1703736-4855-40ac-8eff-ab32d8b8350d tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:31.278377 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-d1703736-4855-40ac-8eff-ab32d8b8350d tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:31.279524 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-d1703736-4855-40ac-8eff-ab32d8b8350d tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1720 microversion: 2.20 time: 0.147503 Jun 07 09:34:31.280090 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 357/719] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:34:31 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1720 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:34:31.388650 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-341517a1-7b04-4438-8696-a5bfe7ab1125 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:34:31.389246 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-341517a1-7b04-4438-8696-a5bfe7ab1125 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 91b69fc3-c7b5-4243-8ee9-47e76d278c8b] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:34:31.395759 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-341517a1-7b04-4438-8696-a5bfe7ab1125 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:31.396205 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-341517a1-7b04-4438-8696-a5bfe7ab1125 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:31.396988 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-341517a1-7b04-4438-8696-a5bfe7ab1125 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:31.397425 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-341517a1-7b04-4438-8696-a5bfe7ab1125 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:31.526512 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-341517a1-7b04-4438-8696-a5bfe7ab1125 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:31.533921 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-341517a1-7b04-4438-8696-a5bfe7ab1125 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/91b69fc3-c7b5-4243-8ee9-47e76d278c8b" status: 200 len: 1367 microversion: 2.1 time: 0.149091 Jun 07 09:34:31.534998 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 363/720] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:34:31 2022] GET /compute/v2.1/servers/91b69fc3-c7b5-4243-8ee9-47e76d278c8b => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:34:32.299280 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-8b35bed0-b6b4-4c2b-9adc-4536a5e19bef tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:34:32.300431 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-8b35bed0-b6b4-4c2b-9adc-4536a5e19bef tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:34:32.306586 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-8b35bed0-b6b4-4c2b-9adc-4536a5e19bef tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:32.308996 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-8b35bed0-b6b4-4c2b-9adc-4536a5e19bef tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:32.308996 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-8b35bed0-b6b4-4c2b-9adc-4536a5e19bef tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:32.308996 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-8b35bed0-b6b4-4c2b-9adc-4536a5e19bef tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:32.434951 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-8b35bed0-b6b4-4c2b-9adc-4536a5e19bef tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:32.442778 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-8b35bed0-b6b4-4c2b-9adc-4536a5e19bef tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:32.444283 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-8b35bed0-b6b4-4c2b-9adc-4536a5e19bef tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:32.445460 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-8b35bed0-b6b4-4c2b-9adc-4536a5e19bef tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1720 microversion: 2.20 time: 0.150212 Jun 07 09:34:32.446020 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 358/721] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:34:32 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1720 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:34:32.551372 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-84904e16-3548-46e5-8d6b-1a4dfad93385 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:34:32.551903 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-84904e16-3548-46e5-8d6b-1a4dfad93385 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 91b69fc3-c7b5-4243-8ee9-47e76d278c8b] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:34:32.558311 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-84904e16-3548-46e5-8d6b-1a4dfad93385 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:32.558759 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-84904e16-3548-46e5-8d6b-1a4dfad93385 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:32.559513 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-84904e16-3548-46e5-8d6b-1a4dfad93385 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:32.559950 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-84904e16-3548-46e5-8d6b-1a4dfad93385 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:32.687502 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-84904e16-3548-46e5-8d6b-1a4dfad93385 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:32.694774 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-84904e16-3548-46e5-8d6b-1a4dfad93385 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/91b69fc3-c7b5-4243-8ee9-47e76d278c8b" status: 200 len: 1367 microversion: 2.1 time: 0.147364 Jun 07 09:34:32.695326 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 364/722] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:34:32 2022] GET /compute/v2.1/servers/91b69fc3-c7b5-4243-8ee9-47e76d278c8b => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:34:33.463501 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-698da5c5-475b-4565-9c99-16996588adab tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:34:33.464102 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-698da5c5-475b-4565-9c99-16996588adab tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:34:33.470156 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-698da5c5-475b-4565-9c99-16996588adab tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:33.470598 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-698da5c5-475b-4565-9c99-16996588adab tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:33.471351 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-698da5c5-475b-4565-9c99-16996588adab tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:33.471816 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-698da5c5-475b-4565-9c99-16996588adab tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:33.599019 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-698da5c5-475b-4565-9c99-16996588adab tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:33.607107 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-698da5c5-475b-4565-9c99-16996588adab tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:33.608632 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-698da5c5-475b-4565-9c99-16996588adab tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:33.609833 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-698da5c5-475b-4565-9c99-16996588adab tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1720 microversion: 2.20 time: 0.150215 Jun 07 09:34:33.610392 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 359/723] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:34:33 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1720 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:34:33.711115 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-06d7568d-5ba6-401c-b026-d9ee8756c5dd tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:34:33.711729 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-06d7568d-5ba6-401c-b026-d9ee8756c5dd tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 91b69fc3-c7b5-4243-8ee9-47e76d278c8b] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:34:33.718356 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-06d7568d-5ba6-401c-b026-d9ee8756c5dd tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:33.718745 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-06d7568d-5ba6-401c-b026-d9ee8756c5dd tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:33.719499 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-06d7568d-5ba6-401c-b026-d9ee8756c5dd tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:33.719953 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-06d7568d-5ba6-401c-b026-d9ee8756c5dd tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:33.735424 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:34:33.853660 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-06d7568d-5ba6-401c-b026-d9ee8756c5dd tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:33.861199 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-06d7568d-5ba6-401c-b026-d9ee8756c5dd tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/91b69fc3-c7b5-4243-8ee9-47e76d278c8b" status: 200 len: 1367 microversion: 2.1 time: 0.153966 Jun 07 09:34:33.861765 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 365/724] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:34:33 2022] GET /compute/v2.1/servers/91b69fc3-c7b5-4243-8ee9-47e76d278c8b => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:34:34.628949 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-72eea5fb-4383-4b2b-bd39-fe030fd59be5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:34:34.629549 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-72eea5fb-4383-4b2b-bd39-fe030fd59be5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:34:34.631480 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writing DB stats nova_cell0:SELECT=2 {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:34:34.632271 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writing DB stats nova_cell0:SELECT=10 {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:34:34.636974 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-72eea5fb-4383-4b2b-bd39-fe030fd59be5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:34.637421 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-72eea5fb-4383-4b2b-bd39-fe030fd59be5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:34.638200 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-72eea5fb-4383-4b2b-bd39-fe030fd59be5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:34.638627 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-72eea5fb-4383-4b2b-bd39-fe030fd59be5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:34.778446 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-72eea5fb-4383-4b2b-bd39-fe030fd59be5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:34.787891 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-72eea5fb-4383-4b2b-bd39-fe030fd59be5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:34.789651 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-72eea5fb-4383-4b2b-bd39-fe030fd59be5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:34.791017 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-72eea5fb-4383-4b2b-bd39-fe030fd59be5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1720 microversion: 2.20 time: 0.166489 Jun 07 09:34:34.797488 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 360/725] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:34:34 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1720 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:34:34.878667 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-c03bce34-07a6-4c71-b86b-80b7ca1f72c2 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:34:34.879306 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-c03bce34-07a6-4c71-b86b-80b7ca1f72c2 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 91b69fc3-c7b5-4243-8ee9-47e76d278c8b] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:34:34.881149 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writing DB stats nova_cell0:SELECT=2 {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:34:34.886728 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-c03bce34-07a6-4c71-b86b-80b7ca1f72c2 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:34.887175 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-c03bce34-07a6-4c71-b86b-80b7ca1f72c2 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:34.888058 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-c03bce34-07a6-4c71-b86b-80b7ca1f72c2 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:34.888504 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-c03bce34-07a6-4c71-b86b-80b7ca1f72c2 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:35.109229 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-c03bce34-07a6-4c71-b86b-80b7ca1f72c2 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:35.116666 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-c03bce34-07a6-4c71-b86b-80b7ca1f72c2 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/91b69fc3-c7b5-4243-8ee9-47e76d278c8b" status: 200 len: 1367 microversion: 2.1 time: 0.241887 Jun 07 09:34:35.117226 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 366/726] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:34:34 2022] GET /compute/v2.1/servers/91b69fc3-c7b5-4243-8ee9-47e76d278c8b => generated 1367 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:34:35.762894 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [req-28560d6d-99d9-4589-8a43-657ee7e801bf req-55dcc14e-b540-4b4f-913e-e1170eafaaef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "102039c7-8224-43f7-9fb8-90b82968cfa2", "name": "network-vif-deleted", "tag": "647bfcc4-5bf0-429c-803e-b72ea4c0fa25"}]} {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:34:35.772281 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [req-28560d6d-99d9-4589-8a43-657ee7e801bf req-55dcc14e-b540-4b4f-913e-e1170eafaaef service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:35.772820 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [req-28560d6d-99d9-4589-8a43-657ee7e801bf req-55dcc14e-b540-4b4f-913e-e1170eafaaef service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:35.784736 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.compute.server_external_events [req-28560d6d-99d9-4589-8a43-657ee7e801bf req-55dcc14e-b540-4b4f-913e-e1170eafaaef service nova] Creating event network-vif-deleted:647bfcc4-5bf0-429c-803e-b72ea4c0fa25 for instance 102039c7-8224-43f7-9fb8-90b82968cfa2 on hv-cinder-83699 Jun 07 09:34:35.789901 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [req-28560d6d-99d9-4589-8a43-657ee7e801bf req-55dcc14e-b540-4b4f-913e-e1170eafaaef service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031456 Jun 07 09:34:35.793592 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 361/727] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Jun 7 09:34:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:34:35.809389 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-929be771-4e7d-46f1-bbfc-8eed46f67e10 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:34:35.810152 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-929be771-4e7d-46f1-bbfc-8eed46f67e10 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:34:35.812109 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:34:35.818163 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-929be771-4e7d-46f1-bbfc-8eed46f67e10 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:35.818754 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-929be771-4e7d-46f1-bbfc-8eed46f67e10 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:35.819391 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-929be771-4e7d-46f1-bbfc-8eed46f67e10 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:35.819988 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-929be771-4e7d-46f1-bbfc-8eed46f67e10 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:35.885160 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-929be771-4e7d-46f1-bbfc-8eed46f67e10 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:35.901152 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-929be771-4e7d-46f1-bbfc-8eed46f67e10 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:35.901152 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-929be771-4e7d-46f1-bbfc-8eed46f67e10 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:35.901152 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-929be771-4e7d-46f1-bbfc-8eed46f67e10 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1653 microversion: 2.20 time: 0.091833 Jun 07 09:34:35.901604 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 367/728] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:34:35 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1653 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:34:36.133976 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-5e295708-c2b0-48fb-9039-884467d8eeba tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:34:36.135193 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-5e295708-c2b0-48fb-9039-884467d8eeba tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 91b69fc3-c7b5-4243-8ee9-47e76d278c8b] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:34:36.141897 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-5e295708-c2b0-48fb-9039-884467d8eeba tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:36.153502 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-5e295708-c2b0-48fb-9039-884467d8eeba tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:36.153502 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-5e295708-c2b0-48fb-9039-884467d8eeba tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:36.153502 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-5e295708-c2b0-48fb-9039-884467d8eeba tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:36.278845 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-5e295708-c2b0-48fb-9039-884467d8eeba tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:36.287069 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-5e295708-c2b0-48fb-9039-884467d8eeba tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/91b69fc3-c7b5-4243-8ee9-47e76d278c8b" status: 200 len: 1367 microversion: 2.1 time: 0.157214 Jun 07 09:34:36.287659 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 362/729] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:34:36 2022] GET /compute/v2.1/servers/91b69fc3-c7b5-4243-8ee9-47e76d278c8b => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:34:36.916025 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-8688c363-4e19-4f2f-89b0-2d677acd1e5d tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:34:36.916662 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-8688c363-4e19-4f2f-89b0-2d677acd1e5d tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:34:36.923356 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-8688c363-4e19-4f2f-89b0-2d677acd1e5d tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:36.923807 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-8688c363-4e19-4f2f-89b0-2d677acd1e5d tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:36.924595 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-8688c363-4e19-4f2f-89b0-2d677acd1e5d tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:36.925039 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-8688c363-4e19-4f2f-89b0-2d677acd1e5d tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:36.955587 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-8688c363-4e19-4f2f-89b0-2d677acd1e5d tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:36.956028 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-8688c363-4e19-4f2f-89b0-2d677acd1e5d tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:36.957002 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.objects.instance [None req-8688c363-4e19-4f2f-89b0-2d677acd1e5d tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lazy-loading 'fault' on Instance uuid 102039c7-8224-43f7-9fb8-90b82968cfa2 {{(pid=118740) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 09:34:36.996834 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-8688c363-4e19-4f2f-89b0-2d677acd1e5d tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:37.004167 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-8688c363-4e19-4f2f-89b0-2d677acd1e5d tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:37.005691 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-8688c363-4e19-4f2f-89b0-2d677acd1e5d tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:37.006904 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-8688c363-4e19-4f2f-89b0-2d677acd1e5d tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 200 len: 1370 microversion: 2.20 time: 0.095091 Jun 07 09:34:37.007464 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 368/730] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:34:36 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 1370 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:34:37.283271 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [req-c6437c75-35af-491d-a0d7-da08b5ea30a7 req-be91b8d3-417c-497a-8f7d-7f79c950c33e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91b69fc3-c7b5-4243-8ee9-47e76d278c8b", "name": "network-vif-plugged", "status": "completed", "tag": "d459ab10-7637-47b2-85a4-a5d49c5f63a8"}]} {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:34:37.292007 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [req-c6437c75-35af-491d-a0d7-da08b5ea30a7 req-be91b8d3-417c-497a-8f7d-7f79c950c33e service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:37.292447 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [req-c6437c75-35af-491d-a0d7-da08b5ea30a7 req-be91b8d3-417c-497a-8f7d-7f79c950c33e service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:37.303210 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.compute.server_external_events [req-c6437c75-35af-491d-a0d7-da08b5ea30a7 req-be91b8d3-417c-497a-8f7d-7f79c950c33e service nova] Creating event network-vif-plugged:d459ab10-7637-47b2-85a4-a5d49c5f63a8 for instance 91b69fc3-c7b5-4243-8ee9-47e76d278c8b on hv-cinder-83699 Jun 07 09:34:37.304241 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-cb99f5ae-8013-4d96-8041-7b38f7d9bb2f tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:34:37.304951 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-cb99f5ae-8013-4d96-8041-7b38f7d9bb2f tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 91b69fc3-c7b5-4243-8ee9-47e76d278c8b] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:34:37.308332 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [req-c6437c75-35af-491d-a0d7-da08b5ea30a7 req-be91b8d3-417c-497a-8f7d-7f79c950c33e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028690 Jun 07 09:34:37.309547 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 363/731] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Jun 7 09:34:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:34:37.311830 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-cb99f5ae-8013-4d96-8041-7b38f7d9bb2f tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:37.312214 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-cb99f5ae-8013-4d96-8041-7b38f7d9bb2f tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:37.312983 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-cb99f5ae-8013-4d96-8041-7b38f7d9bb2f tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:37.313417 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-cb99f5ae-8013-4d96-8041-7b38f7d9bb2f tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:37.447448 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-cb99f5ae-8013-4d96-8041-7b38f7d9bb2f tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:37.455806 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-cb99f5ae-8013-4d96-8041-7b38f7d9bb2f tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/91b69fc3-c7b5-4243-8ee9-47e76d278c8b" status: 200 len: 1367 microversion: 2.1 time: 0.155770 Jun 07 09:34:37.456375 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 369/732] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:34:37 2022] GET /compute/v2.1/servers/91b69fc3-c7b5-4243-8ee9-47e76d278c8b => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:34:38.025814 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-a4d81ae6-93fe-4052-919f-b3a3bcadfe15 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:34:38.026511 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-a4d81ae6-93fe-4052-919f-b3a3bcadfe15 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:34:38.032751 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-a4d81ae6-93fe-4052-919f-b3a3bcadfe15 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:38.033204 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-a4d81ae6-93fe-4052-919f-b3a3bcadfe15 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:38.033962 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-a4d81ae6-93fe-4052-919f-b3a3bcadfe15 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:38.034401 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-a4d81ae6-93fe-4052-919f-b3a3bcadfe15 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:38.047756 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.wsgi [None req-a4d81ae6-93fe-4052-919f-b3a3bcadfe15 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] HTTP exception thrown: Instance 102039c7-8224-43f7-9fb8-90b82968cfa2 could not be found. Jun 07 09:34:38.049334 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-a4d81ae6-93fe-4052-919f-b3a3bcadfe15 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Request method failure captured: Jun 07 09:34:38.049334 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: request: GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 HTTP/1.1 Jun 07 09:34:38.049334 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Accept: application/json Jun 07 09:34:38.049334 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Accept-Encoding: identity Jun 07 09:34:38.049334 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Connection: close Jun 07 09:34:38.049334 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Content-Length: 0 Jun 07 09:34:38.049334 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Content-Type: application/json Jun 07 09:34:38.049334 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Host: 10.222.0.57 Jun 07 09:34:38.049334 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Openstack-System-Scope: None Jun 07 09:34:38.049334 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: User-Agent: python-urllib3/1.26.9 Jun 07 09:34:38.049334 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Auth-Token: gAAAAABinxpG9kQvlOuhvKJ2Vqjyrto1ecBjlF2KyUbgRpshzQ_km2MYNcINagmhfoIU6jkOA0ye_TCrmtu5hyCMaDalA9LLQJ2a4ubAMReTHN66VUyeKRdM4jrOOVTdC3MOlDWtgkiVz2vLBdfCOSyYw9WOl0DXA3JGjzoqxlpjH7qXqpqmKwk Jun 07 09:34:38.049334 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Domain-Id: None Jun 07 09:34:38.049334 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Domain-Name: None Jun 07 09:34:38.049334 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Identity-Status: Confirmed Jun 07 09:34:38.049334 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Is-Admin-Project: True Jun 07 09:34:38.049334 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Openstack-Nova-Api-Version: 2.20 Jun 07 09:34:38.049334 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Project-Domain-Id: default Jun 07 09:34:38.049334 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Project-Domain-Name: Default Jun 07 09:34:38.049334 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Project-Id: 61e2a8b0891548428759a52462a2feaa Jun 07 09:34:38.049334 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1858285605 Jun 07 09:34:38.049334 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Role: reader,member Jun 07 09:34:38.049334 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Roles: reader,member Jun 07 09:34:38.056710 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/61e2a8b0891548428759a52462a2feaa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/61e2a8b0891548428759a52462a2feaa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_61e2a8b0891548428759a52462a2feaa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/61e2a8b0891548428759a52462a2feaa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 07 09:34:38.056710 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1858285605 Jun 07 09:34:38.056710 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Tenant-Id: 61e2a8b0891548428759a52462a2feaa Jun 07 09:34:38.056710 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1858285605 Jun 07 09:34:38.056710 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User: tempest-AttachVolumeShelveTestJSON-1858285605-project Jun 07 09:34:38.056710 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User-Domain-Id: default Jun 07 09:34:38.056710 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User-Domain-Name: Default Jun 07 09:34:38.056710 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User-Id: 06e30bbe21af428faa5ec0eab414abf5 Jun 07 09:34:38.056710 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1858285605-project Jun 07 09:34:38.056710 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: method: > Jun 07 09:34:38.056710 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: exception: Instance 102039c7-8224-43f7-9fb8-90b82968cfa2 could not be found. Jun 07 09:34:38.056710 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: action_args: {'id': '102039c7-8224-43f7-9fb8-90b82968cfa2'} Jun 07 09:34:38.057648 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 09:34:38.057648 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:34:38.057648 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 09:34:38.057648 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 09:34:38.057648 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 09:34:38.057648 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 09:34:38.057648 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 09:34:38.057648 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 09:34:38.057648 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 09:34:38.057648 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 09:34:38.057648 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 102039c7-8224-43f7-9fb8-90b82968cfa2 could not be found. Jun 07 09:34:38.057648 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:34:38.057648 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:34:38.057648 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:34:38.057648 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:34:38.057648 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:34:38.057648 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:34:38.057648 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 09:34:38.057648 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 09:34:38.057648 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 09:34:38.059286 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 09:34:38.059286 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 09:34:38.059286 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 09:34:38.059286 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 09:34:38.059286 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 09:34:38.059286 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 09:34:38.059286 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 09:34:38.059286 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 102039c7-8224-43f7-9fb8-90b82968cfa2 could not be found. Jun 07 09:34:38.059286 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:34:38.059286 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:34:38.059286 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:34:38.059286 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:34:38.059286 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:34:38.059286 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:34:38.059286 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 09:34:38.059286 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 09:34:38.059286 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 102039c7-8224-43f7-9fb8-90b82968cfa2 could not be found. Jun 07 09:34:38.059286 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:34:38.060744 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-a4d81ae6-93fe-4052-919f-b3a3bcadfe15 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Returning 404 to user: Instance 102039c7-8224-43f7-9fb8-90b82968cfa2 could not be found. {{(pid=118741) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 09:34:38.060744 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-a4d81ae6-93fe-4052-919f-b3a3bcadfe15 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 404 len: 111 microversion: 2.20 time: 0.029615 Jun 07 09:34:38.060744 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 364/733] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:34:38 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 07 09:34:38.061007 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-f6197778-d7f9-4803-bab3-84ea5e1bd6f0 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '.version_select at 0x7f5c91d070d0>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:34:38.145986 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-f6197778-d7f9-4803-bab3-84ea5e1bd6f0 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-56273524" status: 204 len: 0 microversion: 2.20 time: 0.089750 Jun 07 09:34:38.146609 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 370/734] 10.222.0.57 () {60 vars in 1255 bytes} [Tue Jun 7 09:34:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-56273524 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 07 09:34:38.473263 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-384a0706-f4ad-4629-bef5-5f5d46320f35 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:34:38.473868 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-384a0706-f4ad-4629-bef5-5f5d46320f35 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 91b69fc3-c7b5-4243-8ee9-47e76d278c8b] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:34:38.480002 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-384a0706-f4ad-4629-bef5-5f5d46320f35 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:38.480449 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-384a0706-f4ad-4629-bef5-5f5d46320f35 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:38.481231 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-384a0706-f4ad-4629-bef5-5f5d46320f35 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:38.481666 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-384a0706-f4ad-4629-bef5-5f5d46320f35 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:38.485673 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writing DB stats nova_cell1:SELECT=100 {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:34:38.612321 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-384a0706-f4ad-4629-bef5-5f5d46320f35 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:38.620298 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-384a0706-f4ad-4629-bef5-5f5d46320f35 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/91b69fc3-c7b5-4243-8ee9-47e76d278c8b" status: 200 len: 1367 microversion: 2.1 time: 0.150871 Jun 07 09:34:38.620888 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 365/735] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:34:38 2022] GET /compute/v2.1/servers/91b69fc3-c7b5-4243-8ee9-47e76d278c8b => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:34:38.924535 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-4efa13d0-c848-47f2-b4f5-2ca5188c7fca tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Action: 'create', calling method: .version_select at 0x7f5c91d9fb80>, body: {"keypair": {"name": "tempest-keypair-1861561043", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIr6mkc9VrnCSLZza1yfX6tgIrst3u14cBXIRZiMVBb+Hrf3nzUTto0zwLcC7s3RM1qJJZ47TSII1RTgG84+YYSd4v0eC+ZHYCckjujAiPqQ75EERK6DrHV1LGTeunTvnQ=="}} {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:34:38.938930 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.quota [None req-4efa13d0-c848-47f2-b4f5-2ca5188c7fca tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Getting quotas for project 61e2a8b0891548428759a52462a2feaa. Resources: {'key_pairs'} {{(pid=118740) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 09:34:38.942864 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.quota [None req-4efa13d0-c848-47f2-b4f5-2ca5188c7fca tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Getting quotas for user 06e30bbe21af428faa5ec0eab414abf5 and project 61e2a8b0891548428759a52462a2feaa. Resources: {'key_pairs'} {{(pid=118740) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 09:34:39.036922 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-4efa13d0-c848-47f2-b4f5-2ca5188c7fca tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.116361 Jun 07 09:34:39.037540 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 371/736] 10.222.0.57 () {62 vars in 1199 bytes} [Tue Jun 7 09:34:38 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 118 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 07 09:34:39.637013 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-e1c80226-86f1-4b79-982c-a7ddca494781 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:34:39.637645 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-e1c80226-86f1-4b79-982c-a7ddca494781 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 91b69fc3-c7b5-4243-8ee9-47e76d278c8b] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:34:39.644602 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-e1c80226-86f1-4b79-982c-a7ddca494781 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:39.645034 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-e1c80226-86f1-4b79-982c-a7ddca494781 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:39.645799 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-e1c80226-86f1-4b79-982c-a7ddca494781 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:39.646237 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-e1c80226-86f1-4b79-982c-a7ddca494781 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:39.793562 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-e1c80226-86f1-4b79-982c-a7ddca494781 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:39.800840 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-e1c80226-86f1-4b79-982c-a7ddca494781 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/91b69fc3-c7b5-4243-8ee9-47e76d278c8b" status: 200 len: 1367 microversion: 2.1 time: 0.167687 Jun 07 09:34:39.801423 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 366/737] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:34:39 2022] GET /compute/v2.1/servers/91b69fc3-c7b5-4243-8ee9-47e76d278c8b => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:34:40.818485 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-cca05629-3054-4d79-b1cf-74755ddbd49a tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:34:40.819097 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-cca05629-3054-4d79-b1cf-74755ddbd49a tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 91b69fc3-c7b5-4243-8ee9-47e76d278c8b] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:34:40.826660 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-cca05629-3054-4d79-b1cf-74755ddbd49a tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:40.827111 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-cca05629-3054-4d79-b1cf-74755ddbd49a tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:40.827877 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-cca05629-3054-4d79-b1cf-74755ddbd49a tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:40.828316 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-cca05629-3054-4d79-b1cf-74755ddbd49a tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:40.979174 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-cca05629-3054-4d79-b1cf-74755ddbd49a tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:40.987117 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-cca05629-3054-4d79-b1cf-74755ddbd49a tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/91b69fc3-c7b5-4243-8ee9-47e76d278c8b" status: 200 len: 1556 microversion: 2.1 time: 0.172523 Jun 07 09:34:40.988078 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 372/738] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:34:40 2022] GET /compute/v2.1/servers/91b69fc3-c7b5-4243-8ee9-47e76d278c8b => generated 1556 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:34:41.005531 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-eafa41e7-1775-491b-90b4-d8bce9399bf8 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:34:41.006049 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-eafa41e7-1775-491b-90b4-d8bce9399bf8 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 91b69fc3-c7b5-4243-8ee9-47e76d278c8b] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:34:41.012058 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-eafa41e7-1775-491b-90b4-d8bce9399bf8 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:41.012505 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-eafa41e7-1775-491b-90b4-d8bce9399bf8 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:41.013705 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-eafa41e7-1775-491b-90b4-d8bce9399bf8 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:41.014136 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-eafa41e7-1775-491b-90b4-d8bce9399bf8 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:41.094135 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-eafa41e7-1775-491b-90b4-d8bce9399bf8 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/91b69fc3-c7b5-4243-8ee9-47e76d278c8b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092658 Jun 07 09:34:41.094682 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 367/739] 10.222.0.57 () {58 vars in 1274 bytes} [Tue Jun 7 09:34:41 2022] GET /compute/v2.1/servers/91b69fc3-c7b5-4243-8ee9-47e76d278c8b/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:34:41.475291 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-1d427728-a3a9-4552-8aea-7ed50f91c836 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2028452343", "imageRef": "8fdb0275-8c58-4c9e-a2f3-3aae3a947526", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f86a2e3c-ba66-428d-84ae-28da9b56628f"}], "security_groups": [{"name": "tempest-securitygroup--621567669"}], "key_name": "tempest-keypair-1861561043", "user_data": "}} {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:34:41.580539 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.network.neutron [None req-1d427728-a3a9-4552-8aea-7ed50f91c836 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] validate_networks() for [('f86a2e3c-ba66-428d-84ae-28da9b56628f', None, None, None, None, None)] {{(pid=118740) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 09:34:41.982646 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.virt.hardware [None req-1d427728-a3a9-4552-8aea-7ed50f91c836 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Flavor limits 0:0:0 {{(pid=118740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 09:34:41.983323 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.virt.hardware [None req-1d427728-a3a9-4552-8aea-7ed50f91c836 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Image limits 0:0:0 {{(pid=118740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 09:34:41.983862 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.virt.hardware [None req-1d427728-a3a9-4552-8aea-7ed50f91c836 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Flavor pref 0:0:0 {{(pid=118740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 09:34:41.984187 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.virt.hardware [None req-1d427728-a3a9-4552-8aea-7ed50f91c836 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Image pref 0:0:0 {{(pid=118740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 09:34:41.984634 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.virt.hardware [None req-1d427728-a3a9-4552-8aea-7ed50f91c836 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 09:34:41.994965 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-1d427728-a3a9-4552-8aea-7ed50f91c836 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:41.995416 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-1d427728-a3a9-4552-8aea-7ed50f91c836 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:41.996217 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-1d427728-a3a9-4552-8aea-7ed50f91c836 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:41.996755 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-1d427728-a3a9-4552-8aea-7ed50f91c836 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:42.014769 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.quota [None req-1d427728-a3a9-4552-8aea-7ed50f91c836 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Getting quotas for project 61e2a8b0891548428759a52462a2feaa. Resources: {'instances', 'cores', 'ram'} {{(pid=118740) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 09:34:42.018921 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.quota [None req-1d427728-a3a9-4552-8aea-7ed50f91c836 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Getting quotas for user 06e30bbe21af428faa5ec0eab414abf5 and project 61e2a8b0891548428759a52462a2feaa. Resources: {'instances', 'cores', 'ram'} {{(pid=118740) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 09:34:42.030250 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-1d427728-a3a9-4552-8aea-7ed50f91c836 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Going to run 1 instances... {{(pid=118740) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 09:34:42.032520 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-1d427728-a3a9-4552-8aea-7ed50f91c836 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 3cc1496a-defc-48eb-8e12-4b328dd6fa31] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8fdb0275-8c58-4c9e-a2f3-3aae3a947526',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118740) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 09:34:42.084889 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [req-01c5039c-737c-44ce-a1e9-56656a11f59e req-b6ed49d0-4f8a-4bb7-8fad-bcedc3df7519 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91b69fc3-c7b5-4243-8ee9-47e76d278c8b", "tag": "d459ab10-7637-47b2-85a4-a5d49c5f63a8"}]} {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:34:42.092779 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [req-01c5039c-737c-44ce-a1e9-56656a11f59e req-b6ed49d0-4f8a-4bb7-8fad-bcedc3df7519 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:42.093218 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [req-01c5039c-737c-44ce-a1e9-56656a11f59e req-b6ed49d0-4f8a-4bb7-8fad-bcedc3df7519 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:42.104932 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.compute.server_external_events [req-01c5039c-737c-44ce-a1e9-56656a11f59e req-b6ed49d0-4f8a-4bb7-8fad-bcedc3df7519 service nova] Creating event network-changed:d459ab10-7637-47b2-85a4-a5d49c5f63a8 for instance 91b69fc3-c7b5-4243-8ee9-47e76d278c8b on hv-cinder-83699 Jun 07 09:34:42.109968 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [req-01c5039c-737c-44ce-a1e9-56656a11f59e req-b6ed49d0-4f8a-4bb7-8fad-bcedc3df7519 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028730 Jun 07 09:34:42.110538 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 368/740] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Jun 7 09:34:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 09:34:42.159971 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-1d427728-a3a9-4552-8aea-7ed50f91c836 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.688982 Jun 07 09:34:42.161554 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 373/741] 10.222.0.57 () {62 vars in 1187 bytes} [Tue Jun 7 09:34:41 2022] POST /compute/v2.1/servers => generated 401 bytes in 691 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 07 09:34:42.172434 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-127cff5b-46d2-4330-87d9-733c934a67b2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:34:42.173170 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-127cff5b-46d2-4330-87d9-733c934a67b2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 3cc1496a-defc-48eb-8e12-4b328dd6fa31] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:34:42.231037 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-127cff5b-46d2-4330-87d9-733c934a67b2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:42.238820 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-127cff5b-46d2-4330-87d9-733c934a67b2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:42.240322 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-127cff5b-46d2-4330-87d9-733c934a67b2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:42.241452 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-127cff5b-46d2-4330-87d9-733c934a67b2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31" status: 200 len: 1282 microversion: 2.20 time: 0.073825 Jun 07 09:34:42.253896 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 369/742] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:34:42 2022] GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31 => generated 1282 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:34:43.259871 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-8e49463a-f3f8-4703-a4ad-0373aad7acba tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:34:43.261149 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-8e49463a-f3f8-4703-a4ad-0373aad7acba tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 3cc1496a-defc-48eb-8e12-4b328dd6fa31] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:34:43.267853 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-8e49463a-f3f8-4703-a4ad-0373aad7acba tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:43.268308 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-8e49463a-f3f8-4703-a4ad-0373aad7acba tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:43.269134 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-8e49463a-f3f8-4703-a4ad-0373aad7acba tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:43.269572 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-8e49463a-f3f8-4703-a4ad-0373aad7acba tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:43.331203 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-8e49463a-f3f8-4703-a4ad-0373aad7acba tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:43.339181 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-8e49463a-f3f8-4703-a4ad-0373aad7acba tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:43.340728 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-8e49463a-f3f8-4703-a4ad-0373aad7acba tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:43.341928 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-8e49463a-f3f8-4703-a4ad-0373aad7acba tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31" status: 200 len: 1286 microversion: 2.20 time: 0.085973 Jun 07 09:34:43.342478 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 374/743] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:34:43 2022] GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31 => generated 1286 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:34:44.360062 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-a81bd6e8-6963-4088-8c1a-d223cbffb62b tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:34:44.360743 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-a81bd6e8-6963-4088-8c1a-d223cbffb62b tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 3cc1496a-defc-48eb-8e12-4b328dd6fa31] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:34:44.368114 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-a81bd6e8-6963-4088-8c1a-d223cbffb62b tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:44.368567 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-a81bd6e8-6963-4088-8c1a-d223cbffb62b tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:44.369366 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-a81bd6e8-6963-4088-8c1a-d223cbffb62b tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:44.369803 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-a81bd6e8-6963-4088-8c1a-d223cbffb62b tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:44.437974 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-a81bd6e8-6963-4088-8c1a-d223cbffb62b tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:44.445992 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-a81bd6e8-6963-4088-8c1a-d223cbffb62b tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:44.447489 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-a81bd6e8-6963-4088-8c1a-d223cbffb62b tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:44.448572 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-a81bd6e8-6963-4088-8c1a-d223cbffb62b tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31" status: 200 len: 1342 microversion: 2.20 time: 0.092423 Jun 07 09:34:44.449151 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 370/744] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:34:44 2022] GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31 => generated 1342 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:34:45.469528 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-3890a28d-3442-4030-b9a7-1e11287da1c6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:34:45.470081 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-3890a28d-3442-4030-b9a7-1e11287da1c6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 3cc1496a-defc-48eb-8e12-4b328dd6fa31] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:34:45.477268 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-3890a28d-3442-4030-b9a7-1e11287da1c6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:45.477748 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-3890a28d-3442-4030-b9a7-1e11287da1c6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:45.478522 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-3890a28d-3442-4030-b9a7-1e11287da1c6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:45.479092 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-3890a28d-3442-4030-b9a7-1e11287da1c6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:45.672979 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-3890a28d-3442-4030-b9a7-1e11287da1c6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:45.680399 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-3890a28d-3442-4030-b9a7-1e11287da1c6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:45.681970 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-3890a28d-3442-4030-b9a7-1e11287da1c6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:45.683070 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-3890a28d-3442-4030-b9a7-1e11287da1c6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31" status: 200 len: 1407 microversion: 2.20 time: 0.217719 Jun 07 09:34:45.683654 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 375/745] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:34:45 2022] GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31 => generated 1407 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:34:46.096573 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [req-33505164-0335-4b60-93f4-38029f71795d req-5d3889fb-e702-4c45-ac50-b2dee49e62a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cc1496a-defc-48eb-8e12-4b328dd6fa31", "tag": "f987791d-1369-4164-867a-29c6d0558f0c"}]} {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:34:46.108027 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [req-33505164-0335-4b60-93f4-38029f71795d req-5d3889fb-e702-4c45-ac50-b2dee49e62a1 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:46.111276 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [req-33505164-0335-4b60-93f4-38029f71795d req-5d3889fb-e702-4c45-ac50-b2dee49e62a1 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:46.121343 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.compute.server_external_events [req-33505164-0335-4b60-93f4-38029f71795d req-5d3889fb-e702-4c45-ac50-b2dee49e62a1 service nova] Creating event network-changed:f987791d-1369-4164-867a-29c6d0558f0c for instance 3cc1496a-defc-48eb-8e12-4b328dd6fa31 on hv-cinder-83699 Jun 07 09:34:46.126150 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [req-33505164-0335-4b60-93f4-38029f71795d req-5d3889fb-e702-4c45-ac50-b2dee49e62a1 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034269 Jun 07 09:34:46.126941 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 371/746] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Jun 7 09:34:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:34:46.703622 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-b1c8c54b-a1d7-4edd-8ee0-44c02cc66339 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:34:46.704300 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-b1c8c54b-a1d7-4edd-8ee0-44c02cc66339 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 3cc1496a-defc-48eb-8e12-4b328dd6fa31] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:34:46.710657 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b1c8c54b-a1d7-4edd-8ee0-44c02cc66339 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:46.711099 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b1c8c54b-a1d7-4edd-8ee0-44c02cc66339 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:46.711862 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b1c8c54b-a1d7-4edd-8ee0-44c02cc66339 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:46.712289 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b1c8c54b-a1d7-4edd-8ee0-44c02cc66339 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:46.938517 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-b1c8c54b-a1d7-4edd-8ee0-44c02cc66339 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:46.946292 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-b1c8c54b-a1d7-4edd-8ee0-44c02cc66339 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:46.947777 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-b1c8c54b-a1d7-4edd-8ee0-44c02cc66339 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:46.948888 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-b1c8c54b-a1d7-4edd-8ee0-44c02cc66339 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31" status: 200 len: 1407 microversion: 2.20 time: 0.251157 Jun 07 09:34:46.949435 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 376/747] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:34:46 2022] GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31 => generated 1407 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:34:47.967836 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-76bc7e81-bbd8-4a0c-8cd6-3f568e6cf987 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:34:47.968556 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-76bc7e81-bbd8-4a0c-8cd6-3f568e6cf987 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 3cc1496a-defc-48eb-8e12-4b328dd6fa31] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:34:47.974719 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-76bc7e81-bbd8-4a0c-8cd6-3f568e6cf987 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:47.975167 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-76bc7e81-bbd8-4a0c-8cd6-3f568e6cf987 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:47.975923 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-76bc7e81-bbd8-4a0c-8cd6-3f568e6cf987 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:47.976357 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-76bc7e81-bbd8-4a0c-8cd6-3f568e6cf987 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:48.101668 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-76bc7e81-bbd8-4a0c-8cd6-3f568e6cf987 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:48.109756 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-76bc7e81-bbd8-4a0c-8cd6-3f568e6cf987 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:48.111239 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-76bc7e81-bbd8-4a0c-8cd6-3f568e6cf987 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:48.112354 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-76bc7e81-bbd8-4a0c-8cd6-3f568e6cf987 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31" status: 200 len: 1407 microversion: 2.20 time: 0.148830 Jun 07 09:34:48.112933 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 372/748] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:34:47 2022] GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31 => generated 1407 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:34:48.601011 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-c2c60df5-b65b-44a2-847f-ff41bbaeaa03 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:34:48.601987 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-c2c60df5-b65b-44a2-847f-ff41bbaeaa03 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:34:48.608613 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-c2c60df5-b65b-44a2-847f-ff41bbaeaa03 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:48.609064 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-c2c60df5-b65b-44a2-847f-ff41bbaeaa03 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:48.609820 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-c2c60df5-b65b-44a2-847f-ff41bbaeaa03 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:48.610250 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-c2c60df5-b65b-44a2-847f-ff41bbaeaa03 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:48.795444 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-c2c60df5-b65b-44a2-847f-ff41bbaeaa03 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.198797 Jun 07 09:34:48.795986 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 377/749] 10.222.0.57 () {58 vars in 1301 bytes} [Tue Jun 7 09:34:48 2022] GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25/os-volume_attachments => generated 25 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 07 09:34:48.852146 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-fae21949-5f11-4d73-9212-3ce9e54a1302 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:34:48.852658 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-fae21949-5f11-4d73-9212-3ce9e54a1302 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:34:48.858905 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-fae21949-5f11-4d73-9212-3ce9e54a1302 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:48.859349 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-fae21949-5f11-4d73-9212-3ce9e54a1302 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:48.860097 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-fae21949-5f11-4d73-9212-3ce9e54a1302 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:48.860529 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-fae21949-5f11-4d73-9212-3ce9e54a1302 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:48.884649 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-fae21949-5f11-4d73-9212-3ce9e54a1302 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25] Going to try to terminate instance {{(pid=118741) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 09:34:49.129771 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-7306c4de-e237-4521-965b-bab57dc65177 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:34:49.130424 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-7306c4de-e237-4521-965b-bab57dc65177 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 3cc1496a-defc-48eb-8e12-4b328dd6fa31] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:34:49.136988 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-7306c4de-e237-4521-965b-bab57dc65177 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:49.137442 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-7306c4de-e237-4521-965b-bab57dc65177 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:49.138237 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-7306c4de-e237-4521-965b-bab57dc65177 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:49.138676 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-7306c4de-e237-4521-965b-bab57dc65177 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:49.146498 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-fae21949-5f11-4d73-9212-3ce9e54a1302 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "DELETE /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25" status: 204 len: 0 microversion: 2.1 time: 0.297731 Jun 07 09:34:49.148163 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 373/750] 10.222.0.57 () {58 vars in 1238 bytes} [Tue Jun 7 09:34:48 2022] DELETE /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 09:34:49.158231 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-4c478dea-1e5e-437c-a696-94c337a864bc tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:34:49.158997 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-4c478dea-1e5e-437c-a696-94c337a864bc tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:34:49.164965 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-4c478dea-1e5e-437c-a696-94c337a864bc tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:49.165462 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-4c478dea-1e5e-437c-a696-94c337a864bc tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:49.166221 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-4c478dea-1e5e-437c-a696-94c337a864bc tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:49.166651 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-4c478dea-1e5e-437c-a696-94c337a864bc tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:49.283076 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-7306c4de-e237-4521-965b-bab57dc65177 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:49.293394 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-7306c4de-e237-4521-965b-bab57dc65177 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:49.295455 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-7306c4de-e237-4521-965b-bab57dc65177 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:49.296258 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-7306c4de-e237-4521-965b-bab57dc65177 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31" status: 200 len: 1407 microversion: 2.20 time: 0.170569 Jun 07 09:34:49.296840 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 378/751] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:34:49 2022] GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31 => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 09:34:49.309508 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-4c478dea-1e5e-437c-a696-94c337a864bc tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0346f4e3855142059983083e71c2c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c21b1cbbd604d6d9c97ab7c3c788f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:49.317012 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-4c478dea-1e5e-437c-a696-94c337a864bc tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25" status: 200 len: 1672 microversion: 2.1 time: 0.163962 Jun 07 09:34:49.317571 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 374/752] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:34:49 2022] GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 => generated 1672 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:34:50.314775 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-58d8dfbb-a301-49e0-80e1-69ac34f791cb tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:34:50.315288 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-58d8dfbb-a301-49e0-80e1-69ac34f791cb tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 3cc1496a-defc-48eb-8e12-4b328dd6fa31] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:34:50.321755 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-58d8dfbb-a301-49e0-80e1-69ac34f791cb tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:50.322208 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-58d8dfbb-a301-49e0-80e1-69ac34f791cb tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:50.322971 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-58d8dfbb-a301-49e0-80e1-69ac34f791cb tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:50.323408 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-58d8dfbb-a301-49e0-80e1-69ac34f791cb tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:50.334597 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-31376d43-a86d-4c71-9d7c-652d651de6e9 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:34:50.335236 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-31376d43-a86d-4c71-9d7c-652d651de6e9 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:34:50.341221 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-31376d43-a86d-4c71-9d7c-652d651de6e9 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:50.341674 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-31376d43-a86d-4c71-9d7c-652d651de6e9 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:50.342432 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-31376d43-a86d-4c71-9d7c-652d651de6e9 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:50.342872 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-31376d43-a86d-4c71-9d7c-652d651de6e9 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:50.450701 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-58d8dfbb-a301-49e0-80e1-69ac34f791cb tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:50.458643 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-58d8dfbb-a301-49e0-80e1-69ac34f791cb tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:50.460739 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-58d8dfbb-a301-49e0-80e1-69ac34f791cb tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:50.461867 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-58d8dfbb-a301-49e0-80e1-69ac34f791cb tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31" status: 200 len: 1407 microversion: 2.20 time: 0.151129 Jun 07 09:34:50.464533 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 379/753] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:34:50 2022] GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31 => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:34:50.478005 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-31376d43-a86d-4c71-9d7c-652d651de6e9 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0346f4e3855142059983083e71c2c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c21b1cbbd604d6d9c97ab7c3c788f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:50.485663 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-31376d43-a86d-4c71-9d7c-652d651de6e9 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25" status: 200 len: 1672 microversion: 2.1 time: 0.154921 Jun 07 09:34:50.486222 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 375/754] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:34:50 2022] GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 => generated 1672 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:34:51.480325 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-b6298aa3-bcf7-4ade-820c-aeacedb4d20c tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:34:51.481619 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-b6298aa3-bcf7-4ade-820c-aeacedb4d20c tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 3cc1496a-defc-48eb-8e12-4b328dd6fa31] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:34:51.488392 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b6298aa3-bcf7-4ade-820c-aeacedb4d20c tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:51.489143 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b6298aa3-bcf7-4ade-820c-aeacedb4d20c tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:51.489933 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b6298aa3-bcf7-4ade-820c-aeacedb4d20c tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:51.490420 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b6298aa3-bcf7-4ade-820c-aeacedb4d20c tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:51.503066 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-9f47de16-ed0d-48c1-b28d-b0c4d46cbb95 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:34:51.503772 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-9f47de16-ed0d-48c1-b28d-b0c4d46cbb95 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:34:51.510615 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-9f47de16-ed0d-48c1-b28d-b0c4d46cbb95 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:51.511362 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-9f47de16-ed0d-48c1-b28d-b0c4d46cbb95 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:51.512314 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-9f47de16-ed0d-48c1-b28d-b0c4d46cbb95 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:51.512933 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-9f47de16-ed0d-48c1-b28d-b0c4d46cbb95 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:51.652302 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-9f47de16-ed0d-48c1-b28d-b0c4d46cbb95 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0346f4e3855142059983083e71c2c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c21b1cbbd604d6d9c97ab7c3c788f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:51.660217 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-9f47de16-ed0d-48c1-b28d-b0c4d46cbb95 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25" status: 200 len: 1672 microversion: 2.1 time: 0.160932 Jun 07 09:34:51.661079 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 376/755] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:34:51 2022] GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 => generated 1672 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:34:51.675391 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [req-9bb25d2e-dad6-4f3b-ab82-36b161f76ed9 req-6ae355c4-3226-48c5-87fd-f46de86598fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cc1496a-defc-48eb-8e12-4b328dd6fa31", "name": "network-vif-plugged", "status": "completed", "tag": "f987791d-1369-4164-867a-29c6d0558f0c"}]} {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:34:51.686575 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [req-9bb25d2e-dad6-4f3b-ab82-36b161f76ed9 req-6ae355c4-3226-48c5-87fd-f46de86598fb service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:51.687015 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [req-9bb25d2e-dad6-4f3b-ab82-36b161f76ed9 req-6ae355c4-3226-48c5-87fd-f46de86598fb service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:51.700853 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.compute.server_external_events [req-9bb25d2e-dad6-4f3b-ab82-36b161f76ed9 req-6ae355c4-3226-48c5-87fd-f46de86598fb service nova] Creating event network-vif-plugged:f987791d-1369-4164-867a-29c6d0558f0c for instance 3cc1496a-defc-48eb-8e12-4b328dd6fa31 on hv-cinder-83699 Jun 07 09:34:51.706467 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [req-9bb25d2e-dad6-4f3b-ab82-36b161f76ed9 req-6ae355c4-3226-48c5-87fd-f46de86598fb service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034719 Jun 07 09:34:51.707661 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 377/756] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Jun 7 09:34:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:34:51.879427 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-b6298aa3-bcf7-4ade-820c-aeacedb4d20c tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:51.888358 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-b6298aa3-bcf7-4ade-820c-aeacedb4d20c tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:51.890111 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-b6298aa3-bcf7-4ade-820c-aeacedb4d20c tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:51.891229 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-b6298aa3-bcf7-4ade-820c-aeacedb4d20c tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31" status: 200 len: 1407 microversion: 2.20 time: 0.415063 Jun 07 09:34:51.891971 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 380/757] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:34:51 2022] GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31 => generated 1407 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:34:52.388751 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [req-1075bcb8-3737-4ac3-8c2f-e25d173a5d7b req-d8208dcd-4104-45fc-8afa-768c6c95ad25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25", "name": "network-vif-deleted", "tag": "0d872428-4ab3-4d4f-845c-f8715f978155"}]} {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:34:52.392877 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writing DB stats nova_cell0:SELECT=2 {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:34:52.398150 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [req-1075bcb8-3737-4ac3-8c2f-e25d173a5d7b req-d8208dcd-4104-45fc-8afa-768c6c95ad25 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:52.402430 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [req-1075bcb8-3737-4ac3-8c2f-e25d173a5d7b req-d8208dcd-4104-45fc-8afa-768c6c95ad25 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:52.409263 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.compute.server_external_events [req-1075bcb8-3737-4ac3-8c2f-e25d173a5d7b req-d8208dcd-4104-45fc-8afa-768c6c95ad25 service nova] Creating event network-vif-deleted:0d872428-4ab3-4d4f-845c-f8715f978155 for instance 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 on hv-cinder-83699 Jun 07 09:34:52.414582 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [req-1075bcb8-3737-4ac3-8c2f-e25d173a5d7b req-d8208dcd-4104-45fc-8afa-768c6c95ad25 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029749 Jun 07 09:34:52.415149 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 378/758] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Jun 7 09:34:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:34:52.677629 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-fe3d9c49-6997-4102-bcf5-f830e47888e0 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:34:52.678275 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-fe3d9c49-6997-4102-bcf5-f830e47888e0 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:34:52.680175 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writing DB stats nova_cell0:SELECT=2 {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:34:52.680987 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writing DB stats nova_cell0:SELECT=10 {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:34:52.686491 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-fe3d9c49-6997-4102-bcf5-f830e47888e0 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:52.686937 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-fe3d9c49-6997-4102-bcf5-f830e47888e0 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:52.687699 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-fe3d9c49-6997-4102-bcf5-f830e47888e0 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:52.688129 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-fe3d9c49-6997-4102-bcf5-f830e47888e0 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:52.756413 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-fe3d9c49-6997-4102-bcf5-f830e47888e0 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0346f4e3855142059983083e71c2c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c21b1cbbd604d6d9c97ab7c3c788f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:52.763924 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-fe3d9c49-6997-4102-bcf5-f830e47888e0 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25" status: 200 len: 1604 microversion: 2.1 time: 0.090265 Jun 07 09:34:52.764478 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 381/759] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:34:52 2022] GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 => generated 1604 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:34:52.910523 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-306c966c-14d3-4c72-a68b-683609252ec6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:34:52.911137 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-306c966c-14d3-4c72-a68b-683609252ec6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 3cc1496a-defc-48eb-8e12-4b328dd6fa31] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:34:52.918446 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-306c966c-14d3-4c72-a68b-683609252ec6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:52.918896 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-306c966c-14d3-4c72-a68b-683609252ec6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:52.919656 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-306c966c-14d3-4c72-a68b-683609252ec6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:52.920095 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-306c966c-14d3-4c72-a68b-683609252ec6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:53.071378 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-306c966c-14d3-4c72-a68b-683609252ec6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:53.079441 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-306c966c-14d3-4c72-a68b-683609252ec6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:53.081068 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-306c966c-14d3-4c72-a68b-683609252ec6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:53.082178 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-306c966c-14d3-4c72-a68b-683609252ec6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31" status: 200 len: 1407 microversion: 2.20 time: 0.176083 Jun 07 09:34:53.082737 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 379/760] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:34:52 2022] GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31 => generated 1407 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:34:53.781277 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-655eac9a-4a32-4f49-b361-fc1eaec51a75 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:34:53.781810 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-655eac9a-4a32-4f49-b361-fc1eaec51a75 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:34:53.789073 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-655eac9a-4a32-4f49-b361-fc1eaec51a75 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:53.789510 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-655eac9a-4a32-4f49-b361-fc1eaec51a75 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:53.790261 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-655eac9a-4a32-4f49-b361-fc1eaec51a75 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:53.790724 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-655eac9a-4a32-4f49-b361-fc1eaec51a75 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:53.820562 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-655eac9a-4a32-4f49-b361-fc1eaec51a75 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:53.821032 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-655eac9a-4a32-4f49-b361-fc1eaec51a75 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:53.821468 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.objects.instance [None req-655eac9a-4a32-4f49-b361-fc1eaec51a75 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lazy-loading 'fault' on Instance uuid 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 {{(pid=118740) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 09:34:53.862014 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-655eac9a-4a32-4f49-b361-fc1eaec51a75 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0346f4e3855142059983083e71c2c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c21b1cbbd604d6d9c97ab7c3c788f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:53.870019 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-655eac9a-4a32-4f49-b361-fc1eaec51a75 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25" status: 200 len: 1326 microversion: 2.1 time: 0.093297 Jun 07 09:34:53.870569 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 382/761] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:34:53 2022] GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 => generated 1326 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:34:54.101255 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-a882d9e2-02f9-4021-9c93-83639267d4b6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:34:54.101784 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-a882d9e2-02f9-4021-9c93-83639267d4b6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 3cc1496a-defc-48eb-8e12-4b328dd6fa31] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:34:54.107970 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-a882d9e2-02f9-4021-9c93-83639267d4b6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:54.108414 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-a882d9e2-02f9-4021-9c93-83639267d4b6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:54.109197 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-a882d9e2-02f9-4021-9c93-83639267d4b6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:54.109629 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-a882d9e2-02f9-4021-9c93-83639267d4b6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:54.234797 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-a882d9e2-02f9-4021-9c93-83639267d4b6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:54.242505 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-a882d9e2-02f9-4021-9c93-83639267d4b6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:54.244021 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-a882d9e2-02f9-4021-9c93-83639267d4b6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:54.245141 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-a882d9e2-02f9-4021-9c93-83639267d4b6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31" status: 200 len: 1407 microversion: 2.20 time: 0.148365 Jun 07 09:34:54.245696 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 380/762] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:34:54 2022] GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31 => generated 1407 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:34:54.893986 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-0b7c7c00-c9ae-4040-873b-e2bcbdf1413b tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:34:54.894623 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-0b7c7c00-c9ae-4040-873b-e2bcbdf1413b tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:34:54.901359 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-0b7c7c00-c9ae-4040-873b-e2bcbdf1413b tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:54.901806 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-0b7c7c00-c9ae-4040-873b-e2bcbdf1413b tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:54.902559 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-0b7c7c00-c9ae-4040-873b-e2bcbdf1413b tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:54.902991 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-0b7c7c00-c9ae-4040-873b-e2bcbdf1413b tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:54.934984 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-0b7c7c00-c9ae-4040-873b-e2bcbdf1413b tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:54.935426 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-0b7c7c00-c9ae-4040-873b-e2bcbdf1413b tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:54.935862 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.objects.instance [None req-0b7c7c00-c9ae-4040-873b-e2bcbdf1413b tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lazy-loading 'fault' on Instance uuid 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 {{(pid=118740) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 09:34:54.976396 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-0b7c7c00-c9ae-4040-873b-e2bcbdf1413b tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0346f4e3855142059983083e71c2c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c21b1cbbd604d6d9c97ab7c3c788f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:54.978636 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writing DB stats nova_cell1:SELECT=100 {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:34:54.984694 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-0b7c7c00-c9ae-4040-873b-e2bcbdf1413b tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25" status: 200 len: 1326 microversion: 2.1 time: 0.094514 Jun 07 09:34:54.985246 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 383/763] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:34:54 2022] GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 => generated 1326 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:34:55.262985 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-1817a1f9-367a-499d-925c-aeb782a1fd72 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:34:55.263507 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-1817a1f9-367a-499d-925c-aeb782a1fd72 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 3cc1496a-defc-48eb-8e12-4b328dd6fa31] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:34:55.269531 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-1817a1f9-367a-499d-925c-aeb782a1fd72 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:55.270008 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-1817a1f9-367a-499d-925c-aeb782a1fd72 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:55.270776 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-1817a1f9-367a-499d-925c-aeb782a1fd72 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:55.271793 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-1817a1f9-367a-499d-925c-aeb782a1fd72 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:55.405856 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-1817a1f9-367a-499d-925c-aeb782a1fd72 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:55.414337 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-1817a1f9-367a-499d-925c-aeb782a1fd72 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:55.415845 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-1817a1f9-367a-499d-925c-aeb782a1fd72 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:34:55.417024 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-1817a1f9-367a-499d-925c-aeb782a1fd72 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31" status: 200 len: 1597 microversion: 2.20 time: 0.157932 Jun 07 09:34:55.417587 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 381/764] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:34:55 2022] GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31 => generated 1597 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:34:55.434958 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-d48060b7-6810-4d06-ae7f-f4b58613475d tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:34:55.435452 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-d48060b7-6810-4d06-ae7f-f4b58613475d tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 3cc1496a-defc-48eb-8e12-4b328dd6fa31] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:34:55.441927 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-d48060b7-6810-4d06-ae7f-f4b58613475d tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:55.442381 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-d48060b7-6810-4d06-ae7f-f4b58613475d tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:55.443167 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-d48060b7-6810-4d06-ae7f-f4b58613475d tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:55.443603 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-d48060b7-6810-4d06-ae7f-f4b58613475d tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:55.520664 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-d48060b7-6810-4d06-ae7f-f4b58613475d tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.089602 Jun 07 09:34:55.521249 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 384/765] 10.222.0.57 () {60 vars in 1315 bytes} [Tue Jun 7 09:34:55 2022] GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 09:34:56.001533 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-7319c22d-91ea-415b-adbc-be9574f4ddb2 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:34:56.002141 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-7319c22d-91ea-415b-adbc-be9574f4ddb2 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:34:56.010689 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-7319c22d-91ea-415b-adbc-be9574f4ddb2 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:56.010689 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-7319c22d-91ea-415b-adbc-be9574f4ddb2 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:56.010689 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-7319c22d-91ea-415b-adbc-be9574f4ddb2 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:56.010689 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-7319c22d-91ea-415b-adbc-be9574f4ddb2 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:56.024774 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.wsgi [None req-7319c22d-91ea-415b-adbc-be9574f4ddb2 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] HTTP exception thrown: Instance 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 could not be found. Jun 07 09:34:56.026418 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-7319c22d-91ea-415b-adbc-be9574f4ddb2 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Request method failure captured: Jun 07 09:34:56.026418 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: request: GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 HTTP/1.1 Jun 07 09:34:56.026418 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Accept: application/json Jun 07 09:34:56.026418 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Accept-Encoding: identity Jun 07 09:34:56.026418 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Connection: close Jun 07 09:34:56.026418 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Content-Length: 0 Jun 07 09:34:56.026418 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Content-Type: application/json Jun 07 09:34:56.026418 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Host: 10.222.0.57 Jun 07 09:34:56.026418 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Openstack-System-Scope: None Jun 07 09:34:56.026418 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: User-Agent: python-urllib3/1.26.9 Jun 07 09:34:56.026418 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Auth-Token: gAAAAABinxo-GawitE_ljpo8B3KPmM3zA3tdmInFKZArRihdFF0HX1G_wnI2oEs2A5OOMQzXUhFYEU3gmYemELsFy4IB2D5fZhyTXLoqx77Bd6giA_LvjMizTHW06nxTaYAdAHd4mxE0GXaJWwbxbkTRGlHLHeGTFfVba_ZXV9BP3j69OQIBYg8 Jun 07 09:34:56.026418 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Domain-Id: None Jun 07 09:34:56.026418 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Domain-Name: None Jun 07 09:34:56.026418 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Identity-Status: Confirmed Jun 07 09:34:56.026418 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Is-Admin-Project: True Jun 07 09:34:56.026418 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Project-Domain-Id: default Jun 07 09:34:56.026418 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Project-Domain-Name: Default Jun 07 09:34:56.026418 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Project-Id: 1c21b1cbbd604d6d9c97ab7c3c788f3d Jun 07 09:34:56.026418 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Project-Name: tempest-AttachVolumeTestJSON-1184144367 Jun 07 09:34:56.026418 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Role: reader,member Jun 07 09:34:56.026418 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Roles: reader,member Jun 07 09:34:56.028102 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1c21b1cbbd604d6d9c97ab7c3c788f3d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1c21b1cbbd604d6d9c97ab7c3c788f3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1c21b1cbbd604d6d9c97ab7c3c788f3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1c21b1cbbd604d6d9c97ab7c3c788f3d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 07 09:34:56.028102 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Tenant: tempest-AttachVolumeTestJSON-1184144367 Jun 07 09:34:56.028102 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Tenant-Id: 1c21b1cbbd604d6d9c97ab7c3c788f3d Jun 07 09:34:56.028102 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1184144367 Jun 07 09:34:56.028102 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User: tempest-AttachVolumeTestJSON-1184144367-project Jun 07 09:34:56.028102 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User-Domain-Id: default Jun 07 09:34:56.028102 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User-Domain-Name: Default Jun 07 09:34:56.028102 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User-Id: 0346f4e3855142059983083e71c2c0c3 Jun 07 09:34:56.028102 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User-Name: tempest-AttachVolumeTestJSON-1184144367-project Jun 07 09:34:56.028102 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: method: > Jun 07 09:34:56.028102 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: exception: Instance 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 could not be found. Jun 07 09:34:56.028102 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: action_args: {'id': '8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25'} Jun 07 09:34:56.029409 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 09:34:56.029409 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:34:56.029409 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 09:34:56.029409 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 09:34:56.029409 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 09:34:56.029409 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 09:34:56.029409 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 09:34:56.029409 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 09:34:56.029409 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 09:34:56.029409 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 09:34:56.029409 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 could not be found. Jun 07 09:34:56.029409 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:34:56.029409 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:34:56.029409 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:34:56.029409 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:34:56.029409 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:34:56.029409 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:34:56.029409 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 09:34:56.029409 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 09:34:56.029409 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 09:34:56.030913 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 09:34:56.030913 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 09:34:56.030913 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 09:34:56.030913 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 09:34:56.030913 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 09:34:56.030913 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 09:34:56.030913 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 09:34:56.030913 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 could not be found. Jun 07 09:34:56.030913 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:34:56.030913 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:34:56.030913 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:34:56.030913 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:34:56.030913 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:34:56.030913 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:34:56.030913 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 09:34:56.030913 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 09:34:56.030913 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 could not be found. Jun 07 09:34:56.030913 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:34:56.032318 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-7319c22d-91ea-415b-adbc-be9574f4ddb2 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Returning 404 to user: Instance 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 could not be found. {{(pid=118741) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 09:34:56.032318 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-7319c22d-91ea-415b-adbc-be9574f4ddb2 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25" status: 404 len: 111 microversion: 2.1 time: 0.030164 Jun 07 09:34:56.032318 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 382/766] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:34:55 2022] GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 09:34:56.038038 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-a34c2153-0066-4093-9b2b-c9091e75ce1a tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '.version_select at 0x7f5c91ea9430>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:34:56.152124 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-a34c2153-0066-4093-9b2b-c9091e75ce1a tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1834568858" status: 202 len: 0 microversion: 2.1 time: 0.118278 Jun 07 09:34:56.152970 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 385/767] 10.222.0.57 () {58 vars in 1220 bytes} [Tue Jun 7 09:34:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1834568858 => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 09:34:56.581602 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [req-75a068e1-fb54-412c-91fd-9b468c191657 req-aa3e0cc4-90d3-4de4-b883-4448263cd00a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cc1496a-defc-48eb-8e12-4b328dd6fa31", "tag": "f987791d-1369-4164-867a-29c6d0558f0c"}]} {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:34:56.590032 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [req-75a068e1-fb54-412c-91fd-9b468c191657 req-aa3e0cc4-90d3-4de4-b883-4448263cd00a service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:56.590481 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [req-75a068e1-fb54-412c-91fd-9b468c191657 req-aa3e0cc4-90d3-4de4-b883-4448263cd00a service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:56.603053 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.compute.server_external_events [req-75a068e1-fb54-412c-91fd-9b468c191657 req-aa3e0cc4-90d3-4de4-b883-4448263cd00a service nova] Creating event network-changed:f987791d-1369-4164-867a-29c6d0558f0c for instance 3cc1496a-defc-48eb-8e12-4b328dd6fa31 on hv-cinder-83699 Jun 07 09:34:56.608574 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [req-75a068e1-fb54-412c-91fd-9b468c191657 req-aa3e0cc4-90d3-4de4-b883-4448263cd00a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030691 Jun 07 09:34:56.609794 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 383/768] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Jun 7 09:34:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:34:57.304890 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-92dcaeaa-970e-46be-b5a2-f31abbe69c90 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Action: 'create', calling method: .version_select at 0x7f5c91e5ff70>, body: {"keypair": {"name": "tempest-keypair-1324739976", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCdq5YnEBhm4aXJYY5xWu2nhPGlMwyu9Cmuv+m8c2Kc/QZ3oQ6xrkoh1Ve+xvLKRv9DshlTkSkIlDAvn8auHGgr1euA3ScwylonLSphlIH840tIfLPhNWS/0D+vtD/fY5g=="}} {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:34:57.319934 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.quota [None req-92dcaeaa-970e-46be-b5a2-f31abbe69c90 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Getting quotas for project 1c21b1cbbd604d6d9c97ab7c3c788f3d. Resources: {'key_pairs'} {{(pid=118740) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 09:34:57.323709 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.quota [None req-92dcaeaa-970e-46be-b5a2-f31abbe69c90 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Getting quotas for user 0346f4e3855142059983083e71c2c0c3 and project 1c21b1cbbd604d6d9c97ab7c3c788f3d. Resources: {'key_pairs'} {{(pid=118740) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 09:34:57.449587 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-92dcaeaa-970e-46be-b5a2-f31abbe69c90 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.149058 Jun 07 09:34:57.450248 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 386/769] 10.222.0.57 () {60 vars in 1158 bytes} [Tue Jun 7 09:34:57 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:34:58.104087 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-01278800-262c-449f-a658-04d87a83ef1a tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:34:58.104972 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-01278800-262c-449f-a658-04d87a83ef1a tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8b9ef09-4309-4fb4-86c8-1f7499c44e75] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:34:58.107021 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1 {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:34:58.111957 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-01278800-262c-449f-a658-04d87a83ef1a tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:58.112413 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-01278800-262c-449f-a658-04d87a83ef1a tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:58.113203 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-01278800-262c-449f-a658-04d87a83ef1a tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:58.113642 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-01278800-262c-449f-a658-04d87a83ef1a tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:58.194487 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.objects.instance [None req-01278800-262c-449f-a658-04d87a83ef1a tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lazy-loading 'services' on Instance uuid a8b9ef09-4309-4fb4-86c8-1f7499c44e75 {{(pid=118741) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 09:34:58.352739 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:34:58.463727 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-01278800-262c-449f-a658-04d87a83ef1a tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "DELETE /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75/os-volume_attachments/3bbd6c72-6020-44c6-86cf-220d349a1e1e" status: 202 len: 0 microversion: 2.1 time: 0.363928 Jun 07 09:34:58.464733 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 384/770] 10.222.0.57 () {58 vars in 1415 bytes} [Tue Jun 7 09:34:58 2022] DELETE /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75/os-volume_attachments/3bbd6c72-6020-44c6-86cf-220d349a1e1e => generated 0 bytes in 366 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 09:34:58.473138 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-5665cd45-d4c9-4564-9340-c4ad573b3af1 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:34:58.474597 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-5665cd45-d4c9-4564-9340-c4ad573b3af1 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8b9ef09-4309-4fb4-86c8-1f7499c44e75] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:34:58.480841 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-5665cd45-d4c9-4564-9340-c4ad573b3af1 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:58.481293 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-5665cd45-d4c9-4564-9340-c4ad573b3af1 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:58.482063 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-5665cd45-d4c9-4564-9340-c4ad573b3af1 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:58.482499 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-5665cd45-d4c9-4564-9340-c4ad573b3af1 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:58.510927 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-5665cd45-d4c9-4564-9340-c4ad573b3af1 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042170 Jun 07 09:34:58.511511 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 387/771] 10.222.0.57 () {58 vars in 1301 bytes} [Tue Jun 7 09:34:58 2022] GET /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:34:59.524374 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-3a43d782-e4ff-40dd-b9b1-fb707107167a tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:34:59.526547 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-3a43d782-e4ff-40dd-b9b1-fb707107167a tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8b9ef09-4309-4fb4-86c8-1f7499c44e75] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:34:59.532185 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-3a43d782-e4ff-40dd-b9b1-fb707107167a tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:59.532654 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-3a43d782-e4ff-40dd-b9b1-fb707107167a tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:59.533439 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-3a43d782-e4ff-40dd-b9b1-fb707107167a tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:34:59.533849 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-3a43d782-e4ff-40dd-b9b1-fb707107167a tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:34:59.565636 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-3a43d782-e4ff-40dd-b9b1-fb707107167a tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046671 Jun 07 09:34:59.566205 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 385/772] 10.222.0.57 () {58 vars in 1301 bytes} [Tue Jun 7 09:34:59 2022] GET /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:34:59.980932 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-4918b1c6-0b64-457f-9908-17efb84e3ec1 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1107271455", "imageRef": "8fdb0275-8c58-4c9e-a2f3-3aae3a947526", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bdba168b-b9af-45e6-8892-12f18759550b"}], "security_groups": [{"name": "tempest-securitygroup--1500887382"}], "key_name": "tempest-keypair-1324739976", "user_data": "}} {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:35:00.080032 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.network.neutron [None req-4918b1c6-0b64-457f-9908-17efb84e3ec1 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] validate_networks() for [('bdba168b-b9af-45e6-8892-12f18759550b', None, None, None, None, None)] {{(pid=118740) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 09:35:00.436804 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.virt.hardware [None req-4918b1c6-0b64-457f-9908-17efb84e3ec1 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Flavor limits 0:0:0 {{(pid=118740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 09:35:00.437230 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.virt.hardware [None req-4918b1c6-0b64-457f-9908-17efb84e3ec1 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Image limits 0:0:0 {{(pid=118740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 09:35:00.437734 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.virt.hardware [None req-4918b1c6-0b64-457f-9908-17efb84e3ec1 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Flavor pref 0:0:0 {{(pid=118740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 09:35:00.438139 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.virt.hardware [None req-4918b1c6-0b64-457f-9908-17efb84e3ec1 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Image pref 0:0:0 {{(pid=118740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 09:35:00.438547 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.virt.hardware [None req-4918b1c6-0b64-457f-9908-17efb84e3ec1 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 09:35:00.447297 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-4918b1c6-0b64-457f-9908-17efb84e3ec1 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:35:00.447694 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-4918b1c6-0b64-457f-9908-17efb84e3ec1 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:35:00.448486 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-4918b1c6-0b64-457f-9908-17efb84e3ec1 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:35:00.448953 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-4918b1c6-0b64-457f-9908-17efb84e3ec1 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:35:00.465585 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.quota [None req-4918b1c6-0b64-457f-9908-17efb84e3ec1 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Getting quotas for project 1c21b1cbbd604d6d9c97ab7c3c788f3d. Resources: {'instances', 'cores', 'ram'} {{(pid=118740) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 09:35:00.469312 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.quota [None req-4918b1c6-0b64-457f-9908-17efb84e3ec1 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Getting quotas for user 0346f4e3855142059983083e71c2c0c3 and project 1c21b1cbbd604d6d9c97ab7c3c788f3d. Resources: {'instances', 'cores', 'ram'} {{(pid=118740) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 09:35:00.478681 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=2,nova_api:INSERT=5 {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:35:00.481378 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-4918b1c6-0b64-457f-9908-17efb84e3ec1 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Going to run 1 instances... {{(pid=118740) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 09:35:00.483478 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-4918b1c6-0b64-457f-9908-17efb84e3ec1 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 51d3266a-292e-4fce-a594-e8cbda085c6e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8fdb0275-8c58-4c9e-a2f3-3aae3a947526',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118740) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 09:35:00.577108 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-d081b0cf-583f-48d0-a615-d85cdf8ae103 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:35:00.578030 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-d081b0cf-583f-48d0-a615-d85cdf8ae103 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8b9ef09-4309-4fb4-86c8-1f7499c44e75] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:35:00.584512 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-d081b0cf-583f-48d0-a615-d85cdf8ae103 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:35:00.589681 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-d081b0cf-583f-48d0-a615-d85cdf8ae103 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:35:00.589681 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-d081b0cf-583f-48d0-a615-d85cdf8ae103 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:35:00.589681 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-d081b0cf-583f-48d0-a615-d85cdf8ae103 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:35:00.615942 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-d081b0cf-583f-48d0-a615-d85cdf8ae103 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042743 Jun 07 09:35:00.623483 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 386/773] 10.222.0.57 () {58 vars in 1301 bytes} [Tue Jun 7 09:35:00 2022] GET /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 07 09:35:00.655649 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-4918b1c6-0b64-457f-9908-17efb84e3ec1 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.679312 Jun 07 09:35:00.662024 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 388/774] 10.222.0.57 () {60 vars in 1146 bytes} [Tue Jun 7 09:34:59 2022] POST /compute/v2.1/servers => generated 402 bytes in 681 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 09:35:00.667456 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-a534ca1a-f66a-41fb-8438-e79de449a988 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:35:00.668426 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-a534ca1a-f66a-41fb-8438-e79de449a988 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 51d3266a-292e-4fce-a594-e8cbda085c6e] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:35:00.685478 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-b25e69f2-c937-4ba2-990f-677f05b4f6e1 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:35:00.686044 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-b25e69f2-c937-4ba2-990f-677f05b4f6e1 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8b9ef09-4309-4fb4-86c8-1f7499c44e75] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:35:00.698942 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b25e69f2-c937-4ba2-990f-677f05b4f6e1 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:35:00.699338 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b25e69f2-c937-4ba2-990f-677f05b4f6e1 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:35:00.700115 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b25e69f2-c937-4ba2-990f-677f05b4f6e1 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:35:00.700546 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b25e69f2-c937-4ba2-990f-677f05b4f6e1 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:35:00.726251 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-b25e69f2-c937-4ba2-990f-677f05b4f6e1 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8b9ef09-4309-4fb4-86c8-1f7499c44e75] Going to try to terminate instance {{(pid=118740) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 09:35:00.743000 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-a534ca1a-f66a-41fb-8438-e79de449a988 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0346f4e3855142059983083e71c2c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c21b1cbbd604d6d9c97ab7c3c788f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:35:00.750307 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-a534ca1a-f66a-41fb-8438-e79de449a988 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/51d3266a-292e-4fce-a594-e8cbda085c6e" status: 200 len: 1238 microversion: 2.1 time: 0.086611 Jun 07 09:35:00.751129 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 387/775] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:35:00 2022] GET /compute/v2.1/servers/51d3266a-292e-4fce-a594-e8cbda085c6e => generated 1238 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:35:01.085903 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-b25e69f2-c937-4ba2-990f-677f05b4f6e1 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "DELETE /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75" status: 204 len: 0 microversion: 2.1 time: 0.404989 Jun 07 09:35:01.086489 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 389/776] 10.222.0.57 () {58 vars in 1238 bytes} [Tue Jun 7 09:35:00 2022] DELETE /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 07 09:35:01.094561 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-323c531b-6fc5-4746-a1d4-29d179abd767 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:35:01.100107 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-323c531b-6fc5-4746-a1d4-29d179abd767 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8b9ef09-4309-4fb4-86c8-1f7499c44e75] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:35:01.101271 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-323c531b-6fc5-4746-a1d4-29d179abd767 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:35:01.101720 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-323c531b-6fc5-4746-a1d4-29d179abd767 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:35:01.102473 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-323c531b-6fc5-4746-a1d4-29d179abd767 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:35:01.102908 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-323c531b-6fc5-4746-a1d4-29d179abd767 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:35:01.232722 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-323c531b-6fc5-4746-a1d4-29d179abd767 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:35:01.240120 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-323c531b-6fc5-4746-a1d4-29d179abd767 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75" status: 200 len: 1690 microversion: 2.1 time: 0.149375 Jun 07 09:35:01.240696 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 388/777] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:35:01 2022] GET /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75 => generated 1690 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:35:01.767789 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-84ddc5be-d7ec-4a11-b00a-b1c334f7670b tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:35:01.768487 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-84ddc5be-d7ec-4a11-b00a-b1c334f7670b tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 51d3266a-292e-4fce-a594-e8cbda085c6e] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:35:01.775197 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-84ddc5be-d7ec-4a11-b00a-b1c334f7670b tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:35:01.775652 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-84ddc5be-d7ec-4a11-b00a-b1c334f7670b tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:35:01.776420 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-84ddc5be-d7ec-4a11-b00a-b1c334f7670b tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:35:01.776888 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-84ddc5be-d7ec-4a11-b00a-b1c334f7670b tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:35:01.837977 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-84ddc5be-d7ec-4a11-b00a-b1c334f7670b tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0346f4e3855142059983083e71c2c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c21b1cbbd604d6d9c97ab7c3c788f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:35:01.845272 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-84ddc5be-d7ec-4a11-b00a-b1c334f7670b tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/51d3266a-292e-4fce-a594-e8cbda085c6e" status: 200 len: 1242 microversion: 2.1 time: 0.081741 Jun 07 09:35:01.845830 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 390/778] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:35:01 2022] GET /compute/v2.1/servers/51d3266a-292e-4fce-a594-e8cbda085c6e => generated 1242 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:35:02.257371 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-5734fb8d-0a24-43ee-bc01-ba1da751abfe tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:35:02.257993 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-5734fb8d-0a24-43ee-bc01-ba1da751abfe tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8b9ef09-4309-4fb4-86c8-1f7499c44e75] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:35:02.263944 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-5734fb8d-0a24-43ee-bc01-ba1da751abfe tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:35:02.264396 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-5734fb8d-0a24-43ee-bc01-ba1da751abfe tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:35:02.265196 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-5734fb8d-0a24-43ee-bc01-ba1da751abfe tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:35:02.265633 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-5734fb8d-0a24-43ee-bc01-ba1da751abfe tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:35:02.395017 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-5734fb8d-0a24-43ee-bc01-ba1da751abfe tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:35:02.403017 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-5734fb8d-0a24-43ee-bc01-ba1da751abfe tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75" status: 200 len: 1690 microversion: 2.1 time: 0.150098 Jun 07 09:35:02.403574 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 389/779] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:35:02 2022] GET /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75 => generated 1690 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:35:02.861790 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-7ace658a-6aad-4818-b7d7-8bf6488b910e tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:35:02.862407 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-7ace658a-6aad-4818-b7d7-8bf6488b910e tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 51d3266a-292e-4fce-a594-e8cbda085c6e] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:35:02.869190 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-7ace658a-6aad-4818-b7d7-8bf6488b910e tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:35:02.869637 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-7ace658a-6aad-4818-b7d7-8bf6488b910e tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:35:02.870408 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-7ace658a-6aad-4818-b7d7-8bf6488b910e tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:35:02.870848 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-7ace658a-6aad-4818-b7d7-8bf6488b910e tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:35:02.930600 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-7ace658a-6aad-4818-b7d7-8bf6488b910e tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0346f4e3855142059983083e71c2c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c21b1cbbd604d6d9c97ab7c3c788f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:35:02.937960 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-7ace658a-6aad-4818-b7d7-8bf6488b910e tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/51d3266a-292e-4fce-a594-e8cbda085c6e" status: 200 len: 1242 microversion: 2.1 time: 0.080039 Jun 07 09:35:02.938518 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 391/780] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:35:02 2022] GET /compute/v2.1/servers/51d3266a-292e-4fce-a594-e8cbda085c6e => generated 1242 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:35:03.419624 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-dfd02445-666e-4e53-b390-d34e5fd03ecd tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:35:03.420238 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-dfd02445-666e-4e53-b390-d34e5fd03ecd tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8b9ef09-4309-4fb4-86c8-1f7499c44e75] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:35:03.426335 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-dfd02445-666e-4e53-b390-d34e5fd03ecd tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:35:03.426787 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-dfd02445-666e-4e53-b390-d34e5fd03ecd tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:35:03.428056 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-dfd02445-666e-4e53-b390-d34e5fd03ecd tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:35:03.428497 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-dfd02445-666e-4e53-b390-d34e5fd03ecd tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:35:03.553992 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-dfd02445-666e-4e53-b390-d34e5fd03ecd tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:35:03.561385 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-dfd02445-666e-4e53-b390-d34e5fd03ecd tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75" status: 200 len: 1690 microversion: 2.1 time: 0.145572 Jun 07 09:35:03.561949 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 390/781] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:35:03 2022] GET /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75 => generated 1690 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:35:03.955160 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-0b3e8368-ca96-4ee8-8e1d-e23b79fd4e0a tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:35:03.955715 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-0b3e8368-ca96-4ee8-8e1d-e23b79fd4e0a tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 51d3266a-292e-4fce-a594-e8cbda085c6e] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:35:03.962249 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-0b3e8368-ca96-4ee8-8e1d-e23b79fd4e0a tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:35:03.962695 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-0b3e8368-ca96-4ee8-8e1d-e23b79fd4e0a tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:35:03.963450 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-0b3e8368-ca96-4ee8-8e1d-e23b79fd4e0a tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:35:03.963884 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-0b3e8368-ca96-4ee8-8e1d-e23b79fd4e0a tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:35:04.024757 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-0b3e8368-ca96-4ee8-8e1d-e23b79fd4e0a tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0346f4e3855142059983083e71c2c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c21b1cbbd604d6d9c97ab7c3c788f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:35:04.032069 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-0b3e8368-ca96-4ee8-8e1d-e23b79fd4e0a tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/51d3266a-292e-4fce-a594-e8cbda085c6e" status: 200 len: 1242 microversion: 2.1 time: 0.080891 Jun 07 09:35:04.032635 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 392/782] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:35:03 2022] GET /compute/v2.1/servers/51d3266a-292e-4fce-a594-e8cbda085c6e => generated 1242 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:35:04.578043 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-e3728db2-4362-475a-b1fd-8f1ea6e96057 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:35:04.578646 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-e3728db2-4362-475a-b1fd-8f1ea6e96057 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8b9ef09-4309-4fb4-86c8-1f7499c44e75] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:35:04.584778 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-e3728db2-4362-475a-b1fd-8f1ea6e96057 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:35:04.585224 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-e3728db2-4362-475a-b1fd-8f1ea6e96057 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:35:04.585972 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-e3728db2-4362-475a-b1fd-8f1ea6e96057 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:35:04.586405 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-e3728db2-4362-475a-b1fd-8f1ea6e96057 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:35:04.713359 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-e3728db2-4362-475a-b1fd-8f1ea6e96057 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:35:04.720947 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-e3728db2-4362-475a-b1fd-8f1ea6e96057 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75" status: 200 len: 1690 microversion: 2.1 time: 0.146672 Jun 07 09:35:04.721680 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 391/783] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:35:04 2022] GET /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75 => generated 1690 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:35:05.048672 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-5be7c532-45fe-4bca-87db-2178de016c35 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:35:05.049278 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-5be7c532-45fe-4bca-87db-2178de016c35 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 51d3266a-292e-4fce-a594-e8cbda085c6e] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:35:05.055581 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-5be7c532-45fe-4bca-87db-2178de016c35 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:35:05.056257 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-5be7c532-45fe-4bca-87db-2178de016c35 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:35:05.057062 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-5be7c532-45fe-4bca-87db-2178de016c35 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:35:05.057491 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-5be7c532-45fe-4bca-87db-2178de016c35 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:35:05.123730 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-5be7c532-45fe-4bca-87db-2178de016c35 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0346f4e3855142059983083e71c2c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c21b1cbbd604d6d9c97ab7c3c788f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:35:05.132012 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-5be7c532-45fe-4bca-87db-2178de016c35 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/51d3266a-292e-4fce-a594-e8cbda085c6e" status: 200 len: 1234 microversion: 2.1 time: 0.087209 Jun 07 09:35:05.132563 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 393/784] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:35:05 2022] GET /compute/v2.1/servers/51d3266a-292e-4fce-a594-e8cbda085c6e => generated 1234 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:35:05.738712 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-5ea60fec-dd42-41ef-b884-242f7a3e673f tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:35:05.746843 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-5ea60fec-dd42-41ef-b884-242f7a3e673f tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8b9ef09-4309-4fb4-86c8-1f7499c44e75] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:35:05.746843 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-5ea60fec-dd42-41ef-b884-242f7a3e673f tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:35:05.746843 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-5ea60fec-dd42-41ef-b884-242f7a3e673f tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:35:05.747445 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-5ea60fec-dd42-41ef-b884-242f7a3e673f tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:35:05.747877 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-5ea60fec-dd42-41ef-b884-242f7a3e673f tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:35:05.813248 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-5ea60fec-dd42-41ef-b884-242f7a3e673f tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:35:05.820762 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-5ea60fec-dd42-41ef-b884-242f7a3e673f tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75" status: 200 len: 1622 microversion: 2.1 time: 0.086000 Jun 07 09:35:05.826905 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 392/785] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:35:05 2022] GET /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75 => generated 1622 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:35:05.979745 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [req-9c47ce3d-5d73-4c1d-a7d6-225c4d66266b req-74ef4e06-0ac8-43aa-a6b4-dd1387f914cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8b9ef09-4309-4fb4-86c8-1f7499c44e75", "name": "network-vif-deleted", "tag": "bb463c81-6e35-47ee-93de-84862189b305"}]} {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:35:05.995355 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [req-9c47ce3d-5d73-4c1d-a7d6-225c4d66266b req-74ef4e06-0ac8-43aa-a6b4-dd1387f914cb service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:35:05.996444 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [req-9c47ce3d-5d73-4c1d-a7d6-225c4d66266b req-74ef4e06-0ac8-43aa-a6b4-dd1387f914cb service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:35:06.013396 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.compute.server_external_events [req-9c47ce3d-5d73-4c1d-a7d6-225c4d66266b req-74ef4e06-0ac8-43aa-a6b4-dd1387f914cb service nova] Creating event network-vif-deleted:bb463c81-6e35-47ee-93de-84862189b305 for instance a8b9ef09-4309-4fb4-86c8-1f7499c44e75 on hv-cinder-83699 Jun 07 09:35:06.018667 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [req-9c47ce3d-5d73-4c1d-a7d6-225c4d66266b req-74ef4e06-0ac8-43aa-a6b4-dd1387f914cb service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044730 Jun 07 09:35:06.019629 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 394/786] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Jun 7 09:35:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:35:06.150886 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-143befde-5dfe-4b15-af8b-7d836cbb819f tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:35:06.151578 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-143befde-5dfe-4b15-af8b-7d836cbb819f tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 51d3266a-292e-4fce-a594-e8cbda085c6e] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:35:06.161077 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-143befde-5dfe-4b15-af8b-7d836cbb819f tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:35:06.162310 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-143befde-5dfe-4b15-af8b-7d836cbb819f tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:35:06.163213 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-143befde-5dfe-4b15-af8b-7d836cbb819f tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:35:06.163720 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-143befde-5dfe-4b15-af8b-7d836cbb819f tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:35:06.284967 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-143befde-5dfe-4b15-af8b-7d836cbb819f tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0346f4e3855142059983083e71c2c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c21b1cbbd604d6d9c97ab7c3c788f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:35:06.293434 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-143befde-5dfe-4b15-af8b-7d836cbb819f tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/51d3266a-292e-4fce-a594-e8cbda085c6e" status: 200 len: 1298 microversion: 2.1 time: 0.148034 Jun 07 09:35:06.294491 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 393/787] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:35:06 2022] GET /compute/v2.1/servers/51d3266a-292e-4fce-a594-e8cbda085c6e => generated 1298 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:35:06.844896 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-b822ad13-7bf6-40c2-94dd-863e007d682d tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:35:06.846642 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-b822ad13-7bf6-40c2-94dd-863e007d682d tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8b9ef09-4309-4fb4-86c8-1f7499c44e75] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:35:06.854783 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b822ad13-7bf6-40c2-94dd-863e007d682d tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:35:06.855235 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b822ad13-7bf6-40c2-94dd-863e007d682d tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:35:06.856017 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b822ad13-7bf6-40c2-94dd-863e007d682d tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:35:06.856491 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b822ad13-7bf6-40c2-94dd-863e007d682d tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:35:06.893461 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b822ad13-7bf6-40c2-94dd-863e007d682d tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:35:06.894062 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b822ad13-7bf6-40c2-94dd-863e007d682d tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:35:06.894537 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.objects.instance [None req-b822ad13-7bf6-40c2-94dd-863e007d682d tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lazy-loading 'fault' on Instance uuid a8b9ef09-4309-4fb4-86c8-1f7499c44e75 {{(pid=118740) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 09:35:06.942962 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-b822ad13-7bf6-40c2-94dd-863e007d682d tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:35:06.951437 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-b822ad13-7bf6-40c2-94dd-863e007d682d tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75" status: 200 len: 1335 microversion: 2.1 time: 0.112326 Jun 07 09:35:06.952181 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 395/788] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:35:06 2022] GET /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75 => generated 1335 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:35:07.311414 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-d9e9dbd0-8e83-4a2e-a702-8a3580248077 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:35:07.312020 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-d9e9dbd0-8e83-4a2e-a702-8a3580248077 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 51d3266a-292e-4fce-a594-e8cbda085c6e] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:35:07.318626 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-d9e9dbd0-8e83-4a2e-a702-8a3580248077 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:35:07.319066 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-d9e9dbd0-8e83-4a2e-a702-8a3580248077 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:35:07.319818 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-d9e9dbd0-8e83-4a2e-a702-8a3580248077 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:35:07.320415 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-d9e9dbd0-8e83-4a2e-a702-8a3580248077 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:35:07.517086 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-d9e9dbd0-8e83-4a2e-a702-8a3580248077 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0346f4e3855142059983083e71c2c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c21b1cbbd604d6d9c97ab7c3c788f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:35:07.530690 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-d9e9dbd0-8e83-4a2e-a702-8a3580248077 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/51d3266a-292e-4fce-a594-e8cbda085c6e" status: 200 len: 1364 microversion: 2.1 time: 0.223311 Jun 07 09:35:07.531287 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 394/789] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:35:07 2022] GET /compute/v2.1/servers/51d3266a-292e-4fce-a594-e8cbda085c6e => generated 1364 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:35:07.969809 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-d8eda43a-0bdc-4f8f-9a0f-ec1cee1ea38d tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:35:07.976892 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-d8eda43a-0bdc-4f8f-9a0f-ec1cee1ea38d tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8b9ef09-4309-4fb4-86c8-1f7499c44e75] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:35:07.984461 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-d8eda43a-0bdc-4f8f-9a0f-ec1cee1ea38d tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:35:07.985201 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-d8eda43a-0bdc-4f8f-9a0f-ec1cee1ea38d tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:35:07.986007 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-d8eda43a-0bdc-4f8f-9a0f-ec1cee1ea38d tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:35:07.986655 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-d8eda43a-0bdc-4f8f-9a0f-ec1cee1ea38d tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:35:08.001770 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.wsgi [None req-d8eda43a-0bdc-4f8f-9a0f-ec1cee1ea38d tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] HTTP exception thrown: Instance a8b9ef09-4309-4fb4-86c8-1f7499c44e75 could not be found. Jun 07 09:35:08.003526 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-d8eda43a-0bdc-4f8f-9a0f-ec1cee1ea38d tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Request method failure captured: Jun 07 09:35:08.003526 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: request: GET /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75 HTTP/1.1 Jun 07 09:35:08.003526 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Accept: application/json Jun 07 09:35:08.003526 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Accept-Encoding: identity Jun 07 09:35:08.003526 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Connection: close Jun 07 09:35:08.003526 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Content-Length: 0 Jun 07 09:35:08.003526 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Content-Type: application/json Jun 07 09:35:08.003526 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Host: 10.222.0.57 Jun 07 09:35:08.003526 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Openstack-System-Scope: None Jun 07 09:35:08.003526 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: User-Agent: python-urllib3/1.26.9 Jun 07 09:35:08.003526 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Auth-Token: gAAAAABinxpHQcjMxh2xTkwKSnc212e9lNltr7CXcs8JAM1TEzohifaHGcSWxwjvcbeQvYXzSUgF9FkXSPBP6LjNAbHU5v1fOXfceR_05Bkuv9pRKNML1vL97YHi3ESy-ou5_XJHettmMtf-Zn05sP8wThXG84KcMgam3l7SF6MkmFpBWtrcAjc Jun 07 09:35:08.003526 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Domain-Id: None Jun 07 09:35:08.003526 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Domain-Name: None Jun 07 09:35:08.003526 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Identity-Status: Confirmed Jun 07 09:35:08.003526 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Is-Admin-Project: True Jun 07 09:35:08.003526 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Domain-Id: default Jun 07 09:35:08.003526 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Domain-Name: Default Jun 07 09:35:08.003526 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Id: 856d592872fa47a2b628f1c3e482b2fd Jun 07 09:35:08.003526 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-738162784 Jun 07 09:35:08.003526 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Role: reader,member Jun 07 09:35:08.003526 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Roles: reader,member Jun 07 09:35:08.004885 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/856d592872fa47a2b628f1c3e482b2fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/856d592872fa47a2b628f1c3e482b2fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_856d592872fa47a2b628f1c3e482b2fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/856d592872fa47a2b628f1c3e482b2fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 07 09:35:08.004885 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Tenant: tempest-ServerRescueNegativeTestJSON-738162784 Jun 07 09:35:08.004885 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Tenant-Id: 856d592872fa47a2b628f1c3e482b2fd Jun 07 09:35:08.004885 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-738162784 Jun 07 09:35:08.004885 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User: tempest-ServerRescueNegativeTestJSON-738162784-project Jun 07 09:35:08.004885 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Domain-Id: default Jun 07 09:35:08.004885 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Domain-Name: Default Jun 07 09:35:08.004885 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Id: 75f6d2e28f024875bda0b20f751bdf0d Jun 07 09:35:08.004885 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Name: tempest-ServerRescueNegativeTestJSON-738162784-project Jun 07 09:35:08.004885 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: method: > Jun 07 09:35:08.004885 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: exception: Instance a8b9ef09-4309-4fb4-86c8-1f7499c44e75 could not be found. Jun 07 09:35:08.004885 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: action_args: {'id': 'a8b9ef09-4309-4fb4-86c8-1f7499c44e75'} Jun 07 09:35:08.009899 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 09:35:08.009899 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:35:08.009899 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 09:35:08.009899 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 09:35:08.009899 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 09:35:08.009899 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 09:35:08.009899 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 09:35:08.009899 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 09:35:08.009899 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 09:35:08.009899 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 09:35:08.009899 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8b9ef09-4309-4fb4-86c8-1f7499c44e75 could not be found. Jun 07 09:35:08.009899 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:35:08.009899 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:35:08.009899 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:35:08.009899 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:35:08.009899 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:35:08.009899 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:35:08.009899 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 09:35:08.009899 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 09:35:08.009899 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 09:35:08.012815 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 09:35:08.012815 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 09:35:08.012815 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 09:35:08.012815 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 09:35:08.012815 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 09:35:08.012815 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 09:35:08.012815 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 09:35:08.012815 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8b9ef09-4309-4fb4-86c8-1f7499c44e75 could not be found. Jun 07 09:35:08.012815 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:35:08.012815 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:35:08.012815 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:35:08.012815 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:35:08.012815 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:35:08.012815 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:35:08.012815 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 09:35:08.012815 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 09:35:08.012815 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8b9ef09-4309-4fb4-86c8-1f7499c44e75 could not be found. Jun 07 09:35:08.012815 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:35:08.015746 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-d8eda43a-0bdc-4f8f-9a0f-ec1cee1ea38d tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Returning 404 to user: Instance a8b9ef09-4309-4fb4-86c8-1f7499c44e75 could not be found. {{(pid=118740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 09:35:08.015746 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-d8eda43a-0bdc-4f8f-9a0f-ec1cee1ea38d tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75" status: 404 len: 111 microversion: 2.1 time: 0.039330 Jun 07 09:35:08.015746 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 396/790] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:35:07 2022] GET /compute/v2.1/servers/a8b9ef09-4309-4fb4-86c8-1f7499c44e75 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 09:35:08.016821 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-b1e73f1d-3a61-4920-a7b8-acf0cb61c152 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '.version_select at 0x7f5c926e9160>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:35:08.123153 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-b1e73f1d-3a61-4920-a7b8-acf0cb61c152 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1423175716" status: 202 len: 0 microversion: 2.1 time: 0.111841 Jun 07 09:35:08.123868 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 395/791] 10.222.0.57 () {58 vars in 1220 bytes} [Tue Jun 7 09:35:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1423175716 => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 09:35:08.315660 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [req-2cd39a83-4db0-40c6-a6ae-1525439bad52 req-a956c131-d4bf-4a39-8ba5-517dfaf30f55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51d3266a-292e-4fce-a594-e8cbda085c6e", "tag": "4ab4124b-15f7-4f01-8f32-ed6e3aaf3c7a"}]} {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:35:08.324863 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [req-2cd39a83-4db0-40c6-a6ae-1525439bad52 req-a956c131-d4bf-4a39-8ba5-517dfaf30f55 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:35:08.325680 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [req-2cd39a83-4db0-40c6-a6ae-1525439bad52 req-a956c131-d4bf-4a39-8ba5-517dfaf30f55 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:35:08.338885 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.compute.server_external_events [req-2cd39a83-4db0-40c6-a6ae-1525439bad52 req-a956c131-d4bf-4a39-8ba5-517dfaf30f55 service nova] Creating event network-changed:4ab4124b-15f7-4f01-8f32-ed6e3aaf3c7a for instance 51d3266a-292e-4fce-a594-e8cbda085c6e on hv-cinder-83699 Jun 07 09:35:08.344168 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [req-2cd39a83-4db0-40c6-a6ae-1525439bad52 req-a956c131-d4bf-4a39-8ba5-517dfaf30f55 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035847 Jun 07 09:35:08.345275 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 397/792] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Jun 7 09:35:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 09:35:08.547434 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-c3689669-f0a6-49d6-89fc-f14edb0a7df7 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:35:08.548057 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-c3689669-f0a6-49d6-89fc-f14edb0a7df7 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 51d3266a-292e-4fce-a594-e8cbda085c6e] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:35:08.554432 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-c3689669-f0a6-49d6-89fc-f14edb0a7df7 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:35:08.554892 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-c3689669-f0a6-49d6-89fc-f14edb0a7df7 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:35:08.555699 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-c3689669-f0a6-49d6-89fc-f14edb0a7df7 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:35:08.557037 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-c3689669-f0a6-49d6-89fc-f14edb0a7df7 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:35:08.890399 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-c3689669-f0a6-49d6-89fc-f14edb0a7df7 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0346f4e3855142059983083e71c2c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c21b1cbbd604d6d9c97ab7c3c788f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:35:08.900049 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-c3689669-f0a6-49d6-89fc-f14edb0a7df7 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/51d3266a-292e-4fce-a594-e8cbda085c6e" status: 200 len: 1364 microversion: 2.1 time: 0.356578 Jun 07 09:35:08.900739 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 396/793] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:35:08 2022] GET /compute/v2.1/servers/51d3266a-292e-4fce-a594-e8cbda085c6e => generated 1364 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:35:09.918065 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-6c844b41-0ba0-4bde-91cf-1ee2b7110bb2 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:35:09.918770 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-6c844b41-0ba0-4bde-91cf-1ee2b7110bb2 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 51d3266a-292e-4fce-a594-e8cbda085c6e] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:35:09.925560 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-6c844b41-0ba0-4bde-91cf-1ee2b7110bb2 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:35:09.926069 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-6c844b41-0ba0-4bde-91cf-1ee2b7110bb2 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:35:09.926838 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-6c844b41-0ba0-4bde-91cf-1ee2b7110bb2 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:35:09.927275 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-6c844b41-0ba0-4bde-91cf-1ee2b7110bb2 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:35:10.059155 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-6c844b41-0ba0-4bde-91cf-1ee2b7110bb2 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0346f4e3855142059983083e71c2c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c21b1cbbd604d6d9c97ab7c3c788f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:35:10.066844 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-6c844b41-0ba0-4bde-91cf-1ee2b7110bb2 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/51d3266a-292e-4fce-a594-e8cbda085c6e" status: 200 len: 1364 microversion: 2.1 time: 0.153256 Jun 07 09:35:10.070112 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 398/794] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:35:09 2022] GET /compute/v2.1/servers/51d3266a-292e-4fce-a594-e8cbda085c6e => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:35:11.083245 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-27e9c7ab-f64b-42e8-a516-d27892ee8096 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:35:11.083928 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-27e9c7ab-f64b-42e8-a516-d27892ee8096 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 51d3266a-292e-4fce-a594-e8cbda085c6e] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:35:11.085972 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writing DB stats nova_cell0:SELECT=2 {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:35:11.090777 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-27e9c7ab-f64b-42e8-a516-d27892ee8096 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:35:11.095374 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-27e9c7ab-f64b-42e8-a516-d27892ee8096 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:35:11.095374 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-27e9c7ab-f64b-42e8-a516-d27892ee8096 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:35:11.095374 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-27e9c7ab-f64b-42e8-a516-d27892ee8096 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:35:11.220078 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-27e9c7ab-f64b-42e8-a516-d27892ee8096 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0346f4e3855142059983083e71c2c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c21b1cbbd604d6d9c97ab7c3c788f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:35:11.228088 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-27e9c7ab-f64b-42e8-a516-d27892ee8096 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/51d3266a-292e-4fce-a594-e8cbda085c6e" status: 200 len: 1364 microversion: 2.1 time: 0.148734 Jun 07 09:35:11.228666 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 397/795] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:35:11 2022] GET /compute/v2.1/servers/51d3266a-292e-4fce-a594-e8cbda085c6e => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:35:11.828111 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-eda089b6-d4eb-4158-8ebc-bffb8a6bbc97 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:35:11.828111 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-eda089b6-d4eb-4158-8ebc-bffb8a6bbc97 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:35:11.828111 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writing DB stats nova_cell0:SELECT=2 {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:35:11.828111 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writing DB stats nova_cell0:SELECT=10 {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:35:11.833364 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-eda089b6-d4eb-4158-8ebc-bffb8a6bbc97 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:35:11.833823 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-eda089b6-d4eb-4158-8ebc-bffb8a6bbc97 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:35:11.834591 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-eda089b6-d4eb-4158-8ebc-bffb8a6bbc97 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:35:11.835035 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-eda089b6-d4eb-4158-8ebc-bffb8a6bbc97 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:35:11.859852 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-eda089b6-d4eb-4158-8ebc-bffb8a6bbc97 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4] Going to try to terminate instance {{(pid=118740) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 09:35:12.244680 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-0a90487e-6768-4bde-ba2d-71c9a51e9c8d tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:35:12.245438 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-0a90487e-6768-4bde-ba2d-71c9a51e9c8d tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 51d3266a-292e-4fce-a594-e8cbda085c6e] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:35:12.253140 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-0a90487e-6768-4bde-ba2d-71c9a51e9c8d tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:35:12.253649 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-0a90487e-6768-4bde-ba2d-71c9a51e9c8d tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:35:12.254505 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-0a90487e-6768-4bde-ba2d-71c9a51e9c8d tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:35:12.254996 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-0a90487e-6768-4bde-ba2d-71c9a51e9c8d tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:35:12.265084 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-eda089b6-d4eb-4158-8ebc-bffb8a6bbc97 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "DELETE /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4" status: 204 len: 0 microversion: 2.1 time: 0.443711 Jun 07 09:35:12.265798 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 399/796] 10.222.0.57 () {58 vars in 1238 bytes} [Tue Jun 7 09:35:11 2022] DELETE /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 09:35:12.275099 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-085486cb-2c5b-4691-bfec-ef1a7d2091d8 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:35:12.275932 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-085486cb-2c5b-4691-bfec-ef1a7d2091d8 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:35:12.281944 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-085486cb-2c5b-4691-bfec-ef1a7d2091d8 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:35:12.282400 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-085486cb-2c5b-4691-bfec-ef1a7d2091d8 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:35:12.283194 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-085486cb-2c5b-4691-bfec-ef1a7d2091d8 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:35:12.283609 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-085486cb-2c5b-4691-bfec-ef1a7d2091d8 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:35:12.394045 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-0a90487e-6768-4bde-ba2d-71c9a51e9c8d tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0346f4e3855142059983083e71c2c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c21b1cbbd604d6d9c97ab7c3c788f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:35:12.402177 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-0a90487e-6768-4bde-ba2d-71c9a51e9c8d tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/51d3266a-292e-4fce-a594-e8cbda085c6e" status: 200 len: 1364 microversion: 2.1 time: 0.161426 Jun 07 09:35:12.402991 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 398/797] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:35:12 2022] GET /compute/v2.1/servers/51d3266a-292e-4fce-a594-e8cbda085c6e => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:35:12.417123 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-085486cb-2c5b-4691-bfec-ef1a7d2091d8 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:35:12.424660 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-085486cb-2c5b-4691-bfec-ef1a7d2091d8 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4" status: 200 len: 1507 microversion: 2.1 time: 0.154213 Jun 07 09:35:12.425215 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 400/798] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:35:12 2022] GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4 => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:35:13.419186 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-cff155c2-0b65-4527-937d-12772ca02261 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:35:13.419785 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-cff155c2-0b65-4527-937d-12772ca02261 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 51d3266a-292e-4fce-a594-e8cbda085c6e] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:35:13.426304 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-cff155c2-0b65-4527-937d-12772ca02261 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:35:13.426753 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-cff155c2-0b65-4527-937d-12772ca02261 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:35:13.427553 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-cff155c2-0b65-4527-937d-12772ca02261 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:35:13.427987 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-cff155c2-0b65-4527-937d-12772ca02261 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:35:13.442126 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-364bb8f2-ca81-4728-81bd-06f27be9270c tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:35:13.443373 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-364bb8f2-ca81-4728-81bd-06f27be9270c tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:35:13.450245 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-364bb8f2-ca81-4728-81bd-06f27be9270c tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:35:13.450747 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-364bb8f2-ca81-4728-81bd-06f27be9270c tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:35:13.451526 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-364bb8f2-ca81-4728-81bd-06f27be9270c tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:35:13.451967 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-364bb8f2-ca81-4728-81bd-06f27be9270c tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:35:13.567209 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-cff155c2-0b65-4527-937d-12772ca02261 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0346f4e3855142059983083e71c2c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c21b1cbbd604d6d9c97ab7c3c788f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:35:13.577289 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-cff155c2-0b65-4527-937d-12772ca02261 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/51d3266a-292e-4fce-a594-e8cbda085c6e" status: 200 len: 1364 microversion: 2.1 time: 0.161774 Jun 07 09:35:13.578681 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 399/799] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:35:13 2022] GET /compute/v2.1/servers/51d3266a-292e-4fce-a594-e8cbda085c6e => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:35:13.596399 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-364bb8f2-ca81-4728-81bd-06f27be9270c tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:35:13.598795 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:35:13.605285 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-364bb8f2-ca81-4728-81bd-06f27be9270c tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4" status: 200 len: 1507 microversion: 2.1 time: 0.167035 Jun 07 09:35:13.605854 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 401/800] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:35:13 2022] GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4 => generated 1507 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:35:13.614283 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [req-08fb9fb9-f5f2-4b02-acc9-44e6d1351149 req-edacade5-b399-428d-8749-2c72ba4552bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51d3266a-292e-4fce-a594-e8cbda085c6e", "name": "network-vif-plugged", "status": "completed", "tag": "4ab4124b-15f7-4f01-8f32-ed6e3aaf3c7a"}]} {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:35:13.622942 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [req-08fb9fb9-f5f2-4b02-acc9-44e6d1351149 req-edacade5-b399-428d-8749-2c72ba4552bb service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:35:13.623411 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [req-08fb9fb9-f5f2-4b02-acc9-44e6d1351149 req-edacade5-b399-428d-8749-2c72ba4552bb service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:35:13.635878 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.compute.server_external_events [req-08fb9fb9-f5f2-4b02-acc9-44e6d1351149 req-edacade5-b399-428d-8749-2c72ba4552bb service nova] Creating event network-vif-plugged:4ab4124b-15f7-4f01-8f32-ed6e3aaf3c7a for instance 51d3266a-292e-4fce-a594-e8cbda085c6e on hv-cinder-83699 Jun 07 09:35:13.640948 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [req-08fb9fb9-f5f2-4b02-acc9-44e6d1351149 req-edacade5-b399-428d-8749-2c72ba4552bb service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030437 Jun 07 09:35:13.641531 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 400/801] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Jun 7 09:35:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 09:35:14.594888 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-d0abf079-7e58-4ff6-bb5f-b6d40a4623e9 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:35:14.595407 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-d0abf079-7e58-4ff6-bb5f-b6d40a4623e9 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 51d3266a-292e-4fce-a594-e8cbda085c6e] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:35:14.602616 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-d0abf079-7e58-4ff6-bb5f-b6d40a4623e9 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:35:14.603161 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-d0abf079-7e58-4ff6-bb5f-b6d40a4623e9 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:35:14.604178 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-d0abf079-7e58-4ff6-bb5f-b6d40a4623e9 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:35:14.604651 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-d0abf079-7e58-4ff6-bb5f-b6d40a4623e9 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:35:14.622014 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-280bbd48-f751-496c-aff2-8d37f1f7f656 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:35:14.622725 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-280bbd48-f751-496c-aff2-8d37f1f7f656 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:35:14.629040 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-280bbd48-f751-496c-aff2-8d37f1f7f656 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:35:14.629495 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-280bbd48-f751-496c-aff2-8d37f1f7f656 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:35:14.630968 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-280bbd48-f751-496c-aff2-8d37f1f7f656 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:35:14.631407 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-280bbd48-f751-496c-aff2-8d37f1f7f656 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:35:14.735931 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-d0abf079-7e58-4ff6-bb5f-b6d40a4623e9 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0346f4e3855142059983083e71c2c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c21b1cbbd604d6d9c97ab7c3c788f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:35:14.744711 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-d0abf079-7e58-4ff6-bb5f-b6d40a4623e9 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/51d3266a-292e-4fce-a594-e8cbda085c6e" status: 200 len: 1364 microversion: 2.1 time: 0.153759 Jun 07 09:35:14.754491 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 402/802] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:35:14 2022] GET /compute/v2.1/servers/51d3266a-292e-4fce-a594-e8cbda085c6e => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:35:14.829987 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [req-f1d725d3-b755-4bc7-8fe0-497890c92b86 req-1f27d521-4b7b-4614-8c29-47ea498026e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4", "name": "network-vif-deleted", "tag": "ef58ec65-d688-494a-a9db-c6f18cac46a0"}]} {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:35:14.838399 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [req-f1d725d3-b755-4bc7-8fe0-497890c92b86 req-1f27d521-4b7b-4614-8c29-47ea498026e6 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:35:14.838915 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [req-f1d725d3-b755-4bc7-8fe0-497890c92b86 req-1f27d521-4b7b-4614-8c29-47ea498026e6 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:35:14.848040 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-280bbd48-f751-496c-aff2-8d37f1f7f656 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:35:14.856784 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-280bbd48-f751-496c-aff2-8d37f1f7f656 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4" status: 200 len: 1507 microversion: 2.1 time: 0.239006 Jun 07 09:35:14.857887 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 401/803] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:35:14 2022] GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4 => generated 1507 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:35:14.863597 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.compute.server_external_events [req-f1d725d3-b755-4bc7-8fe0-497890c92b86 req-1f27d521-4b7b-4614-8c29-47ea498026e6 service nova] Creating event network-vif-deleted:ef58ec65-d688-494a-a9db-c6f18cac46a0 for instance a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4 on hv-cinder-83699 Jun 07 09:35:14.869243 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [req-f1d725d3-b755-4bc7-8fe0-497890c92b86 req-1f27d521-4b7b-4614-8c29-47ea498026e6 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043025 Jun 07 09:35:14.870078 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 403/804] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Jun 7 09:35:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:35:15.761437 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-5a252315-edf7-45fa-879e-c46c20f39b04 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:35:15.762062 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-5a252315-edf7-45fa-879e-c46c20f39b04 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 51d3266a-292e-4fce-a594-e8cbda085c6e] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:35:15.767976 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-5a252315-edf7-45fa-879e-c46c20f39b04 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:35:15.768419 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-5a252315-edf7-45fa-879e-c46c20f39b04 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:35:15.769194 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-5a252315-edf7-45fa-879e-c46c20f39b04 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:35:15.769625 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-5a252315-edf7-45fa-879e-c46c20f39b04 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:35:15.875598 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-f5599ed9-0fd3-4d66-8d20-5c2eae8af7d6 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:35:15.876419 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-f5599ed9-0fd3-4d66-8d20-5c2eae8af7d6 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:35:15.883153 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-f5599ed9-0fd3-4d66-8d20-5c2eae8af7d6 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:35:15.883617 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-f5599ed9-0fd3-4d66-8d20-5c2eae8af7d6 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:35:15.884393 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-f5599ed9-0fd3-4d66-8d20-5c2eae8af7d6 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:35:15.884881 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-f5599ed9-0fd3-4d66-8d20-5c2eae8af7d6 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:35:15.907998 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-5a252315-edf7-45fa-879e-c46c20f39b04 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0346f4e3855142059983083e71c2c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c21b1cbbd604d6d9c97ab7c3c788f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:35:15.910762 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-5a252315-edf7-45fa-879e-c46c20f39b04 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/51d3266a-292e-4fce-a594-e8cbda085c6e" status: 200 len: 1364 microversion: 2.1 time: 0.153192 Jun 07 09:35:15.911326 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 402/805] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:35:15 2022] GET /compute/v2.1/servers/51d3266a-292e-4fce-a594-e8cbda085c6e => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:35:15.916451 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-f5599ed9-0fd3-4d66-8d20-5c2eae8af7d6 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:35:15.917009 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-f5599ed9-0fd3-4d66-8d20-5c2eae8af7d6 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:35:15.917462 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.objects.instance [None req-f5599ed9-0fd3-4d66-8d20-5c2eae8af7d6 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lazy-loading 'fault' on Instance uuid a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4 {{(pid=118740) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 09:35:15.961778 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-f5599ed9-0fd3-4d66-8d20-5c2eae8af7d6 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:35:15.969116 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-f5599ed9-0fd3-4d66-8d20-5c2eae8af7d6 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4" status: 200 len: 1311 microversion: 2.1 time: 0.098698 Jun 07 09:35:15.969676 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 404/806] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:35:15 2022] GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4 => generated 1311 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:35:16.927695 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-4b6530f1-a2ad-4cca-b031-2e2238ed1e66 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:35:16.928396 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-4b6530f1-a2ad-4cca-b031-2e2238ed1e66 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 51d3266a-292e-4fce-a594-e8cbda085c6e] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:35:16.934476 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-4b6530f1-a2ad-4cca-b031-2e2238ed1e66 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:35:16.934988 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-4b6530f1-a2ad-4cca-b031-2e2238ed1e66 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:35:16.935814 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-4b6530f1-a2ad-4cca-b031-2e2238ed1e66 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:35:16.936312 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-4b6530f1-a2ad-4cca-b031-2e2238ed1e66 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:35:16.985924 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-073c6ab0-b637-409a-bca8-17955a948267 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:35:16.986512 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-073c6ab0-b637-409a-bca8-17955a948267 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:35:16.993523 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-073c6ab0-b637-409a-bca8-17955a948267 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:35:16.993972 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-073c6ab0-b637-409a-bca8-17955a948267 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:35:16.994734 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-073c6ab0-b637-409a-bca8-17955a948267 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:35:16.995165 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-073c6ab0-b637-409a-bca8-17955a948267 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:35:17.029081 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-073c6ab0-b637-409a-bca8-17955a948267 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:35:17.029991 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-073c6ab0-b637-409a-bca8-17955a948267 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:35:17.030567 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.objects.instance [None req-073c6ab0-b637-409a-bca8-17955a948267 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lazy-loading 'fault' on Instance uuid a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4 {{(pid=118740) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 09:35:17.072279 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-073c6ab0-b637-409a-bca8-17955a948267 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:35:17.073206 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-4b6530f1-a2ad-4cca-b031-2e2238ed1e66 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0346f4e3855142059983083e71c2c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c21b1cbbd604d6d9c97ab7c3c788f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:35:17.079426 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-073c6ab0-b637-409a-bca8-17955a948267 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4" status: 200 len: 1311 microversion: 2.1 time: 0.097448 Jun 07 09:35:17.080031 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 405/807] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:35:16 2022] GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4 => generated 1311 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:35:17.080987 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-4b6530f1-a2ad-4cca-b031-2e2238ed1e66 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/51d3266a-292e-4fce-a594-e8cbda085c6e" status: 200 len: 1550 microversion: 2.1 time: 0.157649 Jun 07 09:35:17.081546 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 403/808] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:35:16 2022] GET /compute/v2.1/servers/51d3266a-292e-4fce-a594-e8cbda085c6e => generated 1550 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:35:17.097306 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-59ed9328-a387-44cf-8700-f5c4bc64ee9f tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:35:17.097790 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-59ed9328-a387-44cf-8700-f5c4bc64ee9f tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 51d3266a-292e-4fce-a594-e8cbda085c6e] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:35:17.104651 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-59ed9328-a387-44cf-8700-f5c4bc64ee9f tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:35:17.105107 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-59ed9328-a387-44cf-8700-f5c4bc64ee9f tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:35:17.108017 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-59ed9328-a387-44cf-8700-f5c4bc64ee9f tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:35:17.108017 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-59ed9328-a387-44cf-8700-f5c4bc64ee9f tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:35:17.186055 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-59ed9328-a387-44cf-8700-f5c4bc64ee9f tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/51d3266a-292e-4fce-a594-e8cbda085c6e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092548 Jun 07 09:35:17.186631 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 406/809] 10.222.0.57 () {58 vars in 1274 bytes} [Tue Jun 7 09:35:17 2022] GET /compute/v2.1/servers/51d3266a-292e-4fce-a594-e8cbda085c6e/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:35:18.096953 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-cc72c342-deaf-4d2e-934f-2b7e038021ce tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:35:18.100353 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-cc72c342-deaf-4d2e-934f-2b7e038021ce tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:35:18.104743 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-cc72c342-deaf-4d2e-934f-2b7e038021ce tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:35:18.105193 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-cc72c342-deaf-4d2e-934f-2b7e038021ce tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:35:18.105951 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-cc72c342-deaf-4d2e-934f-2b7e038021ce tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:35:18.106387 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-cc72c342-deaf-4d2e-934f-2b7e038021ce tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:35:18.110474 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writing DB stats nova_cell1:SELECT=100 {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:35:18.120564 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.wsgi [None req-cc72c342-deaf-4d2e-934f-2b7e038021ce tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] HTTP exception thrown: Instance a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4 could not be found. Jun 07 09:35:18.122200 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-cc72c342-deaf-4d2e-934f-2b7e038021ce tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Request method failure captured: Jun 07 09:35:18.122200 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: request: GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4 HTTP/1.1 Jun 07 09:35:18.122200 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Accept: application/json Jun 07 09:35:18.122200 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Accept-Encoding: identity Jun 07 09:35:18.122200 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Connection: close Jun 07 09:35:18.122200 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Content-Length: 0 Jun 07 09:35:18.122200 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Content-Type: application/json Jun 07 09:35:18.122200 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Host: 10.222.0.57 Jun 07 09:35:18.122200 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Openstack-System-Scope: None Jun 07 09:35:18.122200 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: User-Agent: python-urllib3/1.26.9 Jun 07 09:35:18.122200 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Auth-Token: gAAAAABinxpHQcjMxh2xTkwKSnc212e9lNltr7CXcs8JAM1TEzohifaHGcSWxwjvcbeQvYXzSUgF9FkXSPBP6LjNAbHU5v1fOXfceR_05Bkuv9pRKNML1vL97YHi3ESy-ou5_XJHettmMtf-Zn05sP8wThXG84KcMgam3l7SF6MkmFpBWtrcAjc Jun 07 09:35:18.122200 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Domain-Id: None Jun 07 09:35:18.122200 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Domain-Name: None Jun 07 09:35:18.122200 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Identity-Status: Confirmed Jun 07 09:35:18.122200 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Is-Admin-Project: True Jun 07 09:35:18.122200 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Project-Domain-Id: default Jun 07 09:35:18.122200 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Project-Domain-Name: Default Jun 07 09:35:18.122200 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Project-Id: 856d592872fa47a2b628f1c3e482b2fd Jun 07 09:35:18.122200 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-738162784 Jun 07 09:35:18.122200 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Role: reader,member Jun 07 09:35:18.122200 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Roles: reader,member Jun 07 09:35:18.125960 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/856d592872fa47a2b628f1c3e482b2fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/856d592872fa47a2b628f1c3e482b2fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_856d592872fa47a2b628f1c3e482b2fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/856d592872fa47a2b628f1c3e482b2fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 07 09:35:18.125960 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Tenant: tempest-ServerRescueNegativeTestJSON-738162784 Jun 07 09:35:18.125960 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Tenant-Id: 856d592872fa47a2b628f1c3e482b2fd Jun 07 09:35:18.125960 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-738162784 Jun 07 09:35:18.125960 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User: tempest-ServerRescueNegativeTestJSON-738162784-project Jun 07 09:35:18.125960 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User-Domain-Id: default Jun 07 09:35:18.125960 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User-Domain-Name: Default Jun 07 09:35:18.125960 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User-Id: 75f6d2e28f024875bda0b20f751bdf0d Jun 07 09:35:18.125960 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User-Name: tempest-ServerRescueNegativeTestJSON-738162784-project Jun 07 09:35:18.125960 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: method: > Jun 07 09:35:18.125960 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: exception: Instance a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4 could not be found. Jun 07 09:35:18.125960 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: action_args: {'id': 'a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4'} Jun 07 09:35:18.126682 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 09:35:18.126682 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:35:18.126682 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 09:35:18.126682 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 09:35:18.126682 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 09:35:18.126682 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 09:35:18.126682 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 09:35:18.126682 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 09:35:18.126682 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 09:35:18.126682 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 09:35:18.126682 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4 could not be found. Jun 07 09:35:18.126682 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:35:18.126682 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:35:18.126682 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:35:18.126682 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:35:18.126682 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:35:18.126682 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:35:18.126682 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 09:35:18.126682 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 09:35:18.126682 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 09:35:18.127869 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 09:35:18.127869 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 09:35:18.127869 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 09:35:18.127869 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 09:35:18.127869 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 09:35:18.127869 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 09:35:18.127869 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 09:35:18.127869 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4 could not be found. Jun 07 09:35:18.127869 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:35:18.127869 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:35:18.127869 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:35:18.127869 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:35:18.127869 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:35:18.127869 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:35:18.127869 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 09:35:18.127869 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 09:35:18.127869 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4 could not be found. Jun 07 09:35:18.127869 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:35:18.129567 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-cc72c342-deaf-4d2e-934f-2b7e038021ce tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Returning 404 to user: Instance a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4 could not be found. {{(pid=118741) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 09:35:18.129567 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-cc72c342-deaf-4d2e-934f-2b7e038021ce tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4" status: 404 len: 111 microversion: 2.1 time: 0.030534 Jun 07 09:35:18.129567 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 404/810] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:35:18 2022] GET /compute/v2.1/servers/a8e8dbc3-0cc5-4894-8028-a5ae1fb2ecf4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 09:35:18.132310 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-59cd62c1-c849-4358-a1cd-31dd225901fb tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:35:18.132833 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-59cd62c1-c849-4358-a1cd-31dd225901fb tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: 77d18a34-ad63-453f-9b17-517bd85a6f42] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:35:18.139438 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-59cd62c1-c849-4358-a1cd-31dd225901fb tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:35:18.139891 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-59cd62c1-c849-4358-a1cd-31dd225901fb tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:35:18.140683 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-59cd62c1-c849-4358-a1cd-31dd225901fb tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:35:18.141121 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-59cd62c1-c849-4358-a1cd-31dd225901fb tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:35:18.166954 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-59cd62c1-c849-4358-a1cd-31dd225901fb tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: 77d18a34-ad63-453f-9b17-517bd85a6f42] Going to try to terminate instance {{(pid=118740) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 09:35:18.443136 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [req-7e5a2800-6460-4b02-ab29-00a658e32b45 req-a87ab082-2be7-4947-b787-332a4bf19141 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51d3266a-292e-4fce-a594-e8cbda085c6e", "tag": "4ab4124b-15f7-4f01-8f32-ed6e3aaf3c7a"}]} {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:35:18.451335 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [req-7e5a2800-6460-4b02-ab29-00a658e32b45 req-a87ab082-2be7-4947-b787-332a4bf19141 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:35:18.451765 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [req-7e5a2800-6460-4b02-ab29-00a658e32b45 req-a87ab082-2be7-4947-b787-332a4bf19141 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:35:18.463350 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.compute.server_external_events [req-7e5a2800-6460-4b02-ab29-00a658e32b45 req-a87ab082-2be7-4947-b787-332a4bf19141 service nova] Creating event network-changed:4ab4124b-15f7-4f01-8f32-ed6e3aaf3c7a for instance 51d3266a-292e-4fce-a594-e8cbda085c6e on hv-cinder-83699 Jun 07 09:35:18.468444 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [req-7e5a2800-6460-4b02-ab29-00a658e32b45 req-a87ab082-2be7-4947-b787-332a4bf19141 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029306 Jun 07 09:35:18.469245 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 405/811] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Jun 7 09:35:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 09:35:18.516168 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-59cd62c1-c849-4358-a1cd-31dd225901fb tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "DELETE /compute/v2.1/servers/77d18a34-ad63-453f-9b17-517bd85a6f42" status: 204 len: 0 microversion: 2.1 time: 0.387443 Jun 07 09:35:18.516886 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 407/812] 10.222.0.57 () {58 vars in 1238 bytes} [Tue Jun 7 09:35:18 2022] DELETE /compute/v2.1/servers/77d18a34-ad63-453f-9b17-517bd85a6f42 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 07 09:35:18.526149 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-b2a29f4e-d44a-4696-962a-8d22a8820628 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:35:18.526933 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-b2a29f4e-d44a-4696-962a-8d22a8820628 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: 77d18a34-ad63-453f-9b17-517bd85a6f42] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:35:18.535673 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b2a29f4e-d44a-4696-962a-8d22a8820628 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:35:18.536234 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b2a29f4e-d44a-4696-962a-8d22a8820628 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:35:18.537172 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b2a29f4e-d44a-4696-962a-8d22a8820628 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:35:18.537679 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b2a29f4e-d44a-4696-962a-8d22a8820628 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:35:18.670850 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-b2a29f4e-d44a-4696-962a-8d22a8820628 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:35:18.678646 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-b2a29f4e-d44a-4696-962a-8d22a8820628 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/77d18a34-ad63-453f-9b17-517bd85a6f42" status: 200 len: 1521 microversion: 2.1 time: 0.156692 Jun 07 09:35:18.679151 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 406/813] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:35:18 2022] GET /compute/v2.1/servers/77d18a34-ad63-453f-9b17-517bd85a6f42 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:35:19.696179 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-aa324ea2-1ec2-4a9b-8799-fec307cb103c tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:35:19.696910 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-aa324ea2-1ec2-4a9b-8799-fec307cb103c tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: 77d18a34-ad63-453f-9b17-517bd85a6f42] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:35:19.703399 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-aa324ea2-1ec2-4a9b-8799-fec307cb103c tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:35:19.703854 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-aa324ea2-1ec2-4a9b-8799-fec307cb103c tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:35:19.704642 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-aa324ea2-1ec2-4a9b-8799-fec307cb103c tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:35:19.705085 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-aa324ea2-1ec2-4a9b-8799-fec307cb103c tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:35:19.830292 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-aa324ea2-1ec2-4a9b-8799-fec307cb103c tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:35:19.837722 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-aa324ea2-1ec2-4a9b-8799-fec307cb103c tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/77d18a34-ad63-453f-9b17-517bd85a6f42" status: 200 len: 1521 microversion: 2.1 time: 0.146322 Jun 07 09:35:19.838282 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 408/814] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:35:19 2022] GET /compute/v2.1/servers/77d18a34-ad63-453f-9b17-517bd85a6f42 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:35:20.855092 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-0b4a7c2a-6418-4548-95a8-b5a2ebf7f46c tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:35:20.855711 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-0b4a7c2a-6418-4548-95a8-b5a2ebf7f46c tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: 77d18a34-ad63-453f-9b17-517bd85a6f42] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:35:20.863018 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-0b4a7c2a-6418-4548-95a8-b5a2ebf7f46c tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:35:20.863470 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-0b4a7c2a-6418-4548-95a8-b5a2ebf7f46c tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:35:20.864243 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-0b4a7c2a-6418-4548-95a8-b5a2ebf7f46c tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:35:20.864722 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-0b4a7c2a-6418-4548-95a8-b5a2ebf7f46c tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:35:20.992001 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-0b4a7c2a-6418-4548-95a8-b5a2ebf7f46c tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:35:20.999486 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-0b4a7c2a-6418-4548-95a8-b5a2ebf7f46c tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/77d18a34-ad63-453f-9b17-517bd85a6f42" status: 200 len: 1521 microversion: 2.1 time: 0.148869 Jun 07 09:35:21.000067 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 407/815] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:35:20 2022] GET /compute/v2.1/servers/77d18a34-ad63-453f-9b17-517bd85a6f42 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:35:21.886211 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [req-bcfcdd5b-b8cf-41db-9ee5-401585264147 req-3f6e5d21-d504-4a98-a87f-2cf3b97d86ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77d18a34-ad63-453f-9b17-517bd85a6f42", "name": "network-vif-deleted", "tag": "34b7939d-c0b3-49e3-ae23-f8bdfdcbb074"}]} {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:35:21.894191 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [req-bcfcdd5b-b8cf-41db-9ee5-401585264147 req-3f6e5d21-d504-4a98-a87f-2cf3b97d86ee service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:35:21.894636 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [req-bcfcdd5b-b8cf-41db-9ee5-401585264147 req-3f6e5d21-d504-4a98-a87f-2cf3b97d86ee service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:35:21.905666 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.compute.server_external_events [req-bcfcdd5b-b8cf-41db-9ee5-401585264147 req-3f6e5d21-d504-4a98-a87f-2cf3b97d86ee service nova] Creating event network-vif-deleted:34b7939d-c0b3-49e3-ae23-f8bdfdcbb074 for instance 77d18a34-ad63-453f-9b17-517bd85a6f42 on hv-cinder-83699 Jun 07 09:35:21.910385 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [req-bcfcdd5b-b8cf-41db-9ee5-401585264147 req-3f6e5d21-d504-4a98-a87f-2cf3b97d86ee service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027977 Jun 07 09:35:21.911560 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 409/816] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Jun 7 09:35:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:35:22.016702 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-017e0977-b049-41b3-93dc-d0053311ecd3 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:35:22.017310 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-017e0977-b049-41b3-93dc-d0053311ecd3 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: 77d18a34-ad63-453f-9b17-517bd85a6f42] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:35:22.023873 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-017e0977-b049-41b3-93dc-d0053311ecd3 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:35:22.024323 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-017e0977-b049-41b3-93dc-d0053311ecd3 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:35:22.025114 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-017e0977-b049-41b3-93dc-d0053311ecd3 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:35:22.025549 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-017e0977-b049-41b3-93dc-d0053311ecd3 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:35:22.089152 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-017e0977-b049-41b3-93dc-d0053311ecd3 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f6d2e28f024875bda0b20f751bdf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856d592872fa47a2b628f1c3e482b2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:35:22.096912 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-017e0977-b049-41b3-93dc-d0053311ecd3 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/77d18a34-ad63-453f-9b17-517bd85a6f42" status: 200 len: 1306 microversion: 2.1 time: 0.084001 Jun 07 09:35:22.097419 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 408/817] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:35:22 2022] GET /compute/v2.1/servers/77d18a34-ad63-453f-9b17-517bd85a6f42 => generated 1306 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:35:23.116402 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-49372f07-7acf-44f2-a092-b9df5c945fd2 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:35:23.117201 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-49372f07-7acf-44f2-a092-b9df5c945fd2 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] [instance: 77d18a34-ad63-453f-9b17-517bd85a6f42] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:35:23.123374 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-49372f07-7acf-44f2-a092-b9df5c945fd2 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:35:23.123834 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-49372f07-7acf-44f2-a092-b9df5c945fd2 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:35:23.124645 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-49372f07-7acf-44f2-a092-b9df5c945fd2 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:35:23.125091 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-49372f07-7acf-44f2-a092-b9df5c945fd2 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:35:23.137882 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.wsgi [None req-49372f07-7acf-44f2-a092-b9df5c945fd2 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] HTTP exception thrown: Instance 77d18a34-ad63-453f-9b17-517bd85a6f42 could not be found. Jun 07 09:35:23.139466 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-49372f07-7acf-44f2-a092-b9df5c945fd2 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Request method failure captured: Jun 07 09:35:23.139466 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: request: GET /compute/v2.1/servers/77d18a34-ad63-453f-9b17-517bd85a6f42 HTTP/1.1 Jun 07 09:35:23.139466 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Accept: application/json Jun 07 09:35:23.139466 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Accept-Encoding: identity Jun 07 09:35:23.139466 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Connection: close Jun 07 09:35:23.139466 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Content-Length: 0 Jun 07 09:35:23.139466 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Content-Type: application/json Jun 07 09:35:23.139466 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Host: 10.222.0.57 Jun 07 09:35:23.139466 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Openstack-System-Scope: None Jun 07 09:35:23.139466 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: User-Agent: python-urllib3/1.26.9 Jun 07 09:35:23.139466 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Auth-Token: gAAAAABinxpHQcjMxh2xTkwKSnc212e9lNltr7CXcs8JAM1TEzohifaHGcSWxwjvcbeQvYXzSUgF9FkXSPBP6LjNAbHU5v1fOXfceR_05Bkuv9pRKNML1vL97YHi3ESy-ou5_XJHettmMtf-Zn05sP8wThXG84KcMgam3l7SF6MkmFpBWtrcAjc Jun 07 09:35:23.139466 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Domain-Id: None Jun 07 09:35:23.139466 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Domain-Name: None Jun 07 09:35:23.139466 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Identity-Status: Confirmed Jun 07 09:35:23.139466 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Is-Admin-Project: True Jun 07 09:35:23.139466 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Domain-Id: default Jun 07 09:35:23.139466 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Domain-Name: Default Jun 07 09:35:23.139466 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Id: 856d592872fa47a2b628f1c3e482b2fd Jun 07 09:35:23.139466 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-738162784 Jun 07 09:35:23.139466 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Role: reader,member Jun 07 09:35:23.139466 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Roles: reader,member Jun 07 09:35:23.141053 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/856d592872fa47a2b628f1c3e482b2fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/856d592872fa47a2b628f1c3e482b2fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_856d592872fa47a2b628f1c3e482b2fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/856d592872fa47a2b628f1c3e482b2fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 07 09:35:23.141053 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Tenant: tempest-ServerRescueNegativeTestJSON-738162784 Jun 07 09:35:23.141053 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Tenant-Id: 856d592872fa47a2b628f1c3e482b2fd Jun 07 09:35:23.141053 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-738162784 Jun 07 09:35:23.141053 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User: tempest-ServerRescueNegativeTestJSON-738162784-project Jun 07 09:35:23.141053 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Domain-Id: default Jun 07 09:35:23.141053 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Domain-Name: Default Jun 07 09:35:23.141053 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Id: 75f6d2e28f024875bda0b20f751bdf0d Jun 07 09:35:23.141053 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Name: tempest-ServerRescueNegativeTestJSON-738162784-project Jun 07 09:35:23.141053 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: method: > Jun 07 09:35:23.141053 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: exception: Instance 77d18a34-ad63-453f-9b17-517bd85a6f42 could not be found. Jun 07 09:35:23.141053 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: action_args: {'id': '77d18a34-ad63-453f-9b17-517bd85a6f42'} Jun 07 09:35:23.142033 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 09:35:23.142033 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:35:23.142033 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 09:35:23.142033 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 09:35:23.142033 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 09:35:23.142033 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 09:35:23.142033 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 09:35:23.142033 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 09:35:23.142033 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 09:35:23.142033 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 09:35:23.142033 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77d18a34-ad63-453f-9b17-517bd85a6f42 could not be found. Jun 07 09:35:23.142033 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:35:23.142033 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:35:23.142033 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:35:23.142033 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:35:23.142033 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:35:23.142033 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:35:23.142033 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 09:35:23.142033 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 09:35:23.142033 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 09:35:23.143538 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 09:35:23.143538 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 09:35:23.143538 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 09:35:23.143538 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 09:35:23.143538 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 09:35:23.143538 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 09:35:23.143538 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 09:35:23.143538 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77d18a34-ad63-453f-9b17-517bd85a6f42 could not be found. Jun 07 09:35:23.143538 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:35:23.143538 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:35:23.143538 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:35:23.143538 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:35:23.143538 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:35:23.143538 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:35:23.143538 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 09:35:23.143538 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 09:35:23.143538 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77d18a34-ad63-453f-9b17-517bd85a6f42 could not be found. Jun 07 09:35:23.143538 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:35:23.145113 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-49372f07-7acf-44f2-a092-b9df5c945fd2 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] Returning 404 to user: Instance 77d18a34-ad63-453f-9b17-517bd85a6f42 could not be found. {{(pid=118740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 09:35:23.145113 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-49372f07-7acf-44f2-a092-b9df5c945fd2 tempest-ServerRescueNegativeTestJSON-738162784 tempest-ServerRescueNegativeTestJSON-738162784-project] 10.222.0.57 "GET /compute/v2.1/servers/77d18a34-ad63-453f-9b17-517bd85a6f42" status: 404 len: 111 microversion: 2.1 time: 0.030513 Jun 07 09:35:23.145113 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 410/818] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:35:23 2022] GET /compute/v2.1/servers/77d18a34-ad63-453f-9b17-517bd85a6f42 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 07 09:36:09.589680 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-d65a2661-8205-4816-af00-da7a6f1ee8cd tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:36:09.590266 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-d65a2661-8205-4816-af00-da7a6f1ee8cd tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 91b69fc3-c7b5-4243-8ee9-47e76d278c8b] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:36:09.593057 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writing DB stats nova_api:SELECT=52,nova_api:DELETE=1 {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:36:09.593827 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writing DB stats nova_cell1:SELECT=20 {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:36:09.598567 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-d65a2661-8205-4816-af00-da7a6f1ee8cd tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:09.603978 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-d65a2661-8205-4816-af00-da7a6f1ee8cd tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:09.603978 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-d65a2661-8205-4816-af00-da7a6f1ee8cd tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:09.603978 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-d65a2661-8205-4816-af00-da7a6f1ee8cd tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:09.623660 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-d65a2661-8205-4816-af00-da7a6f1ee8cd tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/91b69fc3-c7b5-4243-8ee9-47e76d278c8b/ips" status: 200 len: 149 microversion: 2.1 time: 0.038068 Jun 07 09:36:09.624258 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 409/819] 10.222.0.57 () {58 vars in 1247 bytes} [Tue Jun 7 09:36:09 2022] GET /compute/v2.1/servers/91b69fc3-c7b5-4243-8ee9-47e76d278c8b/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:36:12.349357 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-4ad8f23d-fea4-4430-b172-fa339ccc6086 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1da3fa04-6700-481b-ae7c-5178a2014148"}} {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:36:12.350426 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-4ad8f23d-fea4-4430-b172-fa339ccc6086 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 91b69fc3-c7b5-4243-8ee9-47e76d278c8b] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:36:12.352876 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3,nova_api:UPDATE=3 {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:36:12.353775 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:36:12.358633 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-4ad8f23d-fea4-4430-b172-fa339ccc6086 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:12.359083 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-4ad8f23d-fea4-4430-b172-fa339ccc6086 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:12.359848 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-4ad8f23d-fea4-4430-b172-fa339ccc6086 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:12.360279 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-4ad8f23d-fea4-4430-b172-fa339ccc6086 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:13.147649 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-4ad8f23d-fea4-4430-b172-fa339ccc6086 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "POST /compute/v2.1/servers/91b69fc3-c7b5-4243-8ee9-47e76d278c8b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.802209 Jun 07 09:36:13.148292 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 411/820] 10.222.0.57 () {60 vars in 1322 bytes} [Tue Jun 7 09:36:12 2022] POST /compute/v2.1/servers/91b69fc3-c7b5-4243-8ee9-47e76d278c8b/os-volume_attachments => generated 194 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:36:21.719368 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-48d2c37f-9a25-4e85-b112-b3d05a68fcd7 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1da3fa04-6700-481b-ae7c-5178a2014148"}} {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:36:21.720428 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-48d2c37f-9a25-4e85-b112-b3d05a68fcd7 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 91b69fc3-c7b5-4243-8ee9-47e76d278c8b] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:36:21.727406 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-48d2c37f-9a25-4e85-b112-b3d05a68fcd7 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:21.728146 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-48d2c37f-9a25-4e85-b112-b3d05a68fcd7 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:21.728941 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-48d2c37f-9a25-4e85-b112-b3d05a68fcd7 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:21.729376 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-48d2c37f-9a25-4e85-b112-b3d05a68fcd7 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:21.818437 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.wsgi [None req-48d2c37f-9a25-4e85-b112-b3d05a68fcd7 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] HTTP exception thrown: Invalid volume: volume 1da3fa04-6700-481b-ae7c-5178a2014148 is already attached to instances: 91b69fc3-c7b5-4243-8ee9-47e76d278c8b Jun 07 09:36:21.820407 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-48d2c37f-9a25-4e85-b112-b3d05a68fcd7 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Request method failure captured: Jun 07 09:36:21.820407 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: request: POST /compute/v2.1/servers/91b69fc3-c7b5-4243-8ee9-47e76d278c8b/os-volume_attachments HTTP/1.1 Jun 07 09:36:21.820407 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Accept: application/json Jun 07 09:36:21.820407 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Accept-Encoding: identity Jun 07 09:36:21.820407 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Connection: close Jun 07 09:36:21.820407 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Content-Length: 74 Jun 07 09:36:21.820407 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Content-Type: application/json Jun 07 09:36:21.820407 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Host: 10.222.0.57 Jun 07 09:36:21.820407 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Openstack-System-Scope: None Jun 07 09:36:21.820407 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: User-Agent: python-urllib3/1.26.9 Jun 07 09:36:21.820407 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Auth-Token: gAAAAABinxpC12ZwKTW7QgnAffZ7E-ugoEXrTCPY3mQwE3_vl9PU9oHTK85PZ0XjIngREK5HYB-lK6ouZq5luxAqHs--1L8FlbsFi6dx2RXjuHSwD2ZGE9RoKs0Rdw_R-iFZYNlQhLI_1L8kAsNT9zgLS2ggWur5AvuhEXFMSEICdPE44y32YVk Jun 07 09:36:21.820407 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Domain-Id: None Jun 07 09:36:21.820407 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Domain-Name: None Jun 07 09:36:21.820407 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Identity-Status: Confirmed Jun 07 09:36:21.820407 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Is-Admin-Project: True Jun 07 09:36:21.820407 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Project-Domain-Id: default Jun 07 09:36:21.820407 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Project-Domain-Name: Default Jun 07 09:36:21.820407 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Project-Id: 50189b9cf3b145ba84495af8db63c41b Jun 07 09:36:21.820407 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Project-Name: tempest-AttachVolumeNegativeTest-238843557 Jun 07 09:36:21.820407 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Role: reader,member Jun 07 09:36:21.820407 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Roles: reader,member Jun 07 09:36:21.822075 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/50189b9cf3b145ba84495af8db63c41b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/50189b9cf3b145ba84495af8db63c41b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_50189b9cf3b145ba84495af8db63c41b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/50189b9cf3b145ba84495af8db63c41b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 07 09:36:21.822075 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Tenant: tempest-AttachVolumeNegativeTest-238843557 Jun 07 09:36:21.822075 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Tenant-Id: 50189b9cf3b145ba84495af8db63c41b Jun 07 09:36:21.822075 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-238843557 Jun 07 09:36:21.822075 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User: tempest-AttachVolumeNegativeTest-238843557-project Jun 07 09:36:21.822075 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User-Domain-Id: default Jun 07 09:36:21.822075 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User-Domain-Name: Default Jun 07 09:36:21.822075 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User-Id: 2f32356bb0bd4234ba817db581b62aad Jun 07 09:36:21.822075 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User-Name: tempest-AttachVolumeNegativeTest-238843557-project Jun 07 09:36:21.822075 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Jun 07 09:36:21.822075 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: {"volumeAttachment": {"volumeId": "1da3fa04-6700-481b-ae7c-5178a2014148"}} Jun 07 09:36:21.822075 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: method: > Jun 07 09:36:21.823015 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: exception: Invalid volume: volume 1da3fa04-6700-481b-ae7c-5178a2014148 is already attached to instances: 91b69fc3-c7b5-4243-8ee9-47e76d278c8b Jun 07 09:36:21.823015 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: action_args: {'server_id': '91b69fc3-c7b5-4243-8ee9-47e76d278c8b', 'body': {'volumeAttachment': {'volumeId': '1da3fa04-6700-481b-ae7c-5178a2014148'}}} Jun 07 09:36:21.823015 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 09:36:21.823015 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:36:21.823015 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 07 09:36:21.823015 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 07 09:36:21.823015 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 07 09:36:21.823015 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 07 09:36:21.823015 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 07 09:36:21.823015 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 07 09:36:21.823015 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 07 09:36:21.823015 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 07 09:36:21.823015 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 07 09:36:21.823015 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 07 09:36:21.823015 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 1da3fa04-6700-481b-ae7c-5178a2014148 is already attached to instances: 91b69fc3-c7b5-4243-8ee9-47e76d278c8b Jun 07 09:36:21.823015 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:36:21.823015 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:36:21.823015 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:36:21.823015 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:36:21.831089 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:36:21.831089 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:36:21.831089 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 09:36:21.831089 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 09:36:21.831089 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 09:36:21.831089 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 09:36:21.831089 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 07 09:36:21.831089 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 09:36:21.831089 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 07 09:36:21.831089 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 09:36:21.831089 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 07 09:36:21.831089 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 09:36:21.831089 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 07 09:36:21.831089 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 07 09:36:21.831089 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 1da3fa04-6700-481b-ae7c-5178a2014148 is already attached to instances: 91b69fc3-c7b5-4243-8ee9-47e76d278c8b Jun 07 09:36:21.831089 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:36:21.831089 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:36:21.831089 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:36:21.831089 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:36:21.831089 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:36:21.832913 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:36:21.832913 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 09:36:21.832913 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 09:36:21.832913 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 1da3fa04-6700-481b-ae7c-5178a2014148 is already attached to instances: 91b69fc3-c7b5-4243-8ee9-47e76d278c8b Jun 07 09:36:21.832913 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:36:21.832913 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-48d2c37f-9a25-4e85-b112-b3d05a68fcd7 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Returning 400 to user: Invalid volume: volume 1da3fa04-6700-481b-ae7c-5178a2014148 is already attached to instances: 91b69fc3-c7b5-4243-8ee9-47e76d278c8b {{(pid=118741) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 09:36:21.832913 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-48d2c37f-9a25-4e85-b112-b3d05a68fcd7 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "POST /compute/v2.1/servers/91b69fc3-c7b5-4243-8ee9-47e76d278c8b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.111367 Jun 07 09:36:21.832913 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 410/821] 10.222.0.57 () {60 vars in 1322 bytes} [Tue Jun 7 09:36:21 2022] POST /compute/v2.1/servers/91b69fc3-c7b5-4243-8ee9-47e76d278c8b/os-volume_attachments => generated 174 bytes in 113 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 07 09:36:21.894079 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-bde63c2d-7a68-4d80-ade9-15e1623f3ad6 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:36:21.894079 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-bde63c2d-7a68-4d80-ade9-15e1623f3ad6 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 91b69fc3-c7b5-4243-8ee9-47e76d278c8b] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:36:21.900246 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-bde63c2d-7a68-4d80-ade9-15e1623f3ad6 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:21.900740 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-bde63c2d-7a68-4d80-ade9-15e1623f3ad6 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:21.901550 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-bde63c2d-7a68-4d80-ade9-15e1623f3ad6 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:21.901990 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-bde63c2d-7a68-4d80-ade9-15e1623f3ad6 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:21.986266 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.objects.instance [None req-bde63c2d-7a68-4d80-ade9-15e1623f3ad6 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lazy-loading 'services' on Instance uuid 91b69fc3-c7b5-4243-8ee9-47e76d278c8b {{(pid=118740) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 09:36:22.198327 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-bde63c2d-7a68-4d80-ade9-15e1623f3ad6 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "DELETE /compute/v2.1/servers/91b69fc3-c7b5-4243-8ee9-47e76d278c8b/os-volume_attachments/1da3fa04-6700-481b-ae7c-5178a2014148" status: 202 len: 0 microversion: 2.1 time: 0.309958 Jun 07 09:36:22.198924 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 412/822] 10.222.0.57 () {58 vars in 1415 bytes} [Tue Jun 7 09:36:21 2022] DELETE /compute/v2.1/servers/91b69fc3-c7b5-4243-8ee9-47e76d278c8b/os-volume_attachments/1da3fa04-6700-481b-ae7c-5178a2014148 => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 09:36:22.207653 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-eb339b67-2609-4c9c-be16-6bfc17745a4a tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:36:22.208659 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-eb339b67-2609-4c9c-be16-6bfc17745a4a tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 91b69fc3-c7b5-4243-8ee9-47e76d278c8b] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:36:22.215538 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-eb339b67-2609-4c9c-be16-6bfc17745a4a tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:22.215992 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-eb339b67-2609-4c9c-be16-6bfc17745a4a tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:22.216792 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-eb339b67-2609-4c9c-be16-6bfc17745a4a tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:22.217237 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-eb339b67-2609-4c9c-be16-6bfc17745a4a tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:22.245854 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-eb339b67-2609-4c9c-be16-6bfc17745a4a tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/91b69fc3-c7b5-4243-8ee9-47e76d278c8b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042485 Jun 07 09:36:22.246964 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 411/823] 10.222.0.57 () {58 vars in 1301 bytes} [Tue Jun 7 09:36:22 2022] GET /compute/v2.1/servers/91b69fc3-c7b5-4243-8ee9-47e76d278c8b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:36:23.180792 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-5069944c-e613-4654-ac00-4ae8e7c0f2bf tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:36:23.181370 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-5069944c-e613-4654-ac00-4ae8e7c0f2bf tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 3cc1496a-defc-48eb-8e12-4b328dd6fa31] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:36:23.188244 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-5069944c-e613-4654-ac00-4ae8e7c0f2bf tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:23.188736 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-5069944c-e613-4654-ac00-4ae8e7c0f2bf tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:23.189509 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-5069944c-e613-4654-ac00-4ae8e7c0f2bf tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:23.189991 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-5069944c-e613-4654-ac00-4ae8e7c0f2bf tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:23.216004 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-5069944c-e613-4654-ac00-4ae8e7c0f2bf tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31/ips" status: 200 len: 150 microversion: 2.20 time: 0.040095 Jun 07 09:36:23.216607 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 413/824] 10.222.0.57 () {60 vars in 1288 bytes} [Tue Jun 7 09:36:23 2022] GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31/ips => generated 150 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 09:36:23.258034 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-360e82e4-a1e2-4668-a83a-1e9ecb5fecfb tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:36:23.258959 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-360e82e4-a1e2-4668-a83a-1e9ecb5fecfb tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 91b69fc3-c7b5-4243-8ee9-47e76d278c8b] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:36:23.265495 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-360e82e4-a1e2-4668-a83a-1e9ecb5fecfb tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:23.265953 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-360e82e4-a1e2-4668-a83a-1e9ecb5fecfb tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:23.266711 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-360e82e4-a1e2-4668-a83a-1e9ecb5fecfb tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:23.267150 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-360e82e4-a1e2-4668-a83a-1e9ecb5fecfb tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:23.295561 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-360e82e4-a1e2-4668-a83a-1e9ecb5fecfb tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/91b69fc3-c7b5-4243-8ee9-47e76d278c8b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041476 Jun 07 09:36:23.296137 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 412/825] 10.222.0.57 () {58 vars in 1301 bytes} [Tue Jun 7 09:36:23 2022] GET /compute/v2.1/servers/91b69fc3-c7b5-4243-8ee9-47e76d278c8b/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:36:24.307027 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-61f74945-7392-4f77-9da1-7d1a81419a03 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:36:24.308344 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-61f74945-7392-4f77-9da1-7d1a81419a03 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 91b69fc3-c7b5-4243-8ee9-47e76d278c8b] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:36:24.315061 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-61f74945-7392-4f77-9da1-7d1a81419a03 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:24.315516 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-61f74945-7392-4f77-9da1-7d1a81419a03 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:24.316332 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-61f74945-7392-4f77-9da1-7d1a81419a03 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:24.316807 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-61f74945-7392-4f77-9da1-7d1a81419a03 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:24.345963 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-61f74945-7392-4f77-9da1-7d1a81419a03 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/91b69fc3-c7b5-4243-8ee9-47e76d278c8b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043240 Jun 07 09:36:24.346504 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 414/826] 10.222.0.57 () {58 vars in 1301 bytes} [Tue Jun 7 09:36:24 2022] GET /compute/v2.1/servers/91b69fc3-c7b5-4243-8ee9-47e76d278c8b/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 07 09:36:24.489866 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-5d07c92b-171b-4b39-84d6-cddda33f8652 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:36:24.489866 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-5d07c92b-171b-4b39-84d6-cddda33f8652 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 91b69fc3-c7b5-4243-8ee9-47e76d278c8b] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:36:24.489866 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-5d07c92b-171b-4b39-84d6-cddda33f8652 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:24.489866 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-5d07c92b-171b-4b39-84d6-cddda33f8652 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:24.490592 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-5d07c92b-171b-4b39-84d6-cddda33f8652 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:24.490592 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-5d07c92b-171b-4b39-84d6-cddda33f8652 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:24.490592 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-5d07c92b-171b-4b39-84d6-cddda33f8652 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 91b69fc3-c7b5-4243-8ee9-47e76d278c8b] Going to try to terminate instance {{(pid=118741) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 09:36:24.743510 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-5d07c92b-171b-4b39-84d6-cddda33f8652 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "DELETE /compute/v2.1/servers/91b69fc3-c7b5-4243-8ee9-47e76d278c8b" status: 204 len: 0 microversion: 2.1 time: 0.302554 Jun 07 09:36:24.744101 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 413/827] 10.222.0.57 () {58 vars in 1238 bytes} [Tue Jun 7 09:36:24 2022] DELETE /compute/v2.1/servers/91b69fc3-c7b5-4243-8ee9-47e76d278c8b => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 09:36:24.753654 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-6c55dd41-ee03-4b16-94ab-de963c37fa57 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:36:24.753654 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-6c55dd41-ee03-4b16-94ab-de963c37fa57 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 91b69fc3-c7b5-4243-8ee9-47e76d278c8b] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:36:24.759101 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-6c55dd41-ee03-4b16-94ab-de963c37fa57 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:24.759548 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-6c55dd41-ee03-4b16-94ab-de963c37fa57 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:24.760315 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-6c55dd41-ee03-4b16-94ab-de963c37fa57 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:24.760769 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-6c55dd41-ee03-4b16-94ab-de963c37fa57 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:24.894260 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-6c55dd41-ee03-4b16-94ab-de963c37fa57 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:24.901790 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-6c55dd41-ee03-4b16-94ab-de963c37fa57 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/91b69fc3-c7b5-4243-8ee9-47e76d278c8b" status: 200 len: 1681 microversion: 2.1 time: 0.152939 Jun 07 09:36:24.908203 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 415/828] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:36:24 2022] GET /compute/v2.1/servers/91b69fc3-c7b5-4243-8ee9-47e76d278c8b => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:36:25.319219 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-cbf53ab3-522b-45be-8c28-d39a3199300b tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:36:25.319840 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-cbf53ab3-522b-45be-8c28-d39a3199300b tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 3cc1496a-defc-48eb-8e12-4b328dd6fa31] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:36:25.325876 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-cbf53ab3-522b-45be-8c28-d39a3199300b tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:25.326562 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-cbf53ab3-522b-45be-8c28-d39a3199300b tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:25.327332 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-cbf53ab3-522b-45be-8c28-d39a3199300b tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:25.327766 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-cbf53ab3-522b-45be-8c28-d39a3199300b tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:25.350201 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.objects.instance [None req-cbf53ab3-522b-45be-8c28-d39a3199300b tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lazy-loading 'flavor' on Instance uuid 3cc1496a-defc-48eb-8e12-4b328dd6fa31 {{(pid=118741) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 09:36:25.912339 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-cbf53ab3-522b-45be-8c28-d39a3199300b tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "POST /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31/action" status: 202 len: 0 microversion: 2.20 time: 0.597179 Jun 07 09:36:25.913292 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 414/829] 10.222.0.57 () {62 vars in 1318 bytes} [Tue Jun 7 09:36:25 2022] POST /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31/action => generated 0 bytes in 599 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 07 09:36:25.919155 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-58a8f6d5-b497-495e-82f4-31c8088c05b8 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:36:25.925891 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-58a8f6d5-b497-495e-82f4-31c8088c05b8 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 91b69fc3-c7b5-4243-8ee9-47e76d278c8b] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:36:25.926066 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-e3d451ca-f3a7-4036-b4f2-8d4d980217d6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:36:25.926066 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-e3d451ca-f3a7-4036-b4f2-8d4d980217d6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 3cc1496a-defc-48eb-8e12-4b328dd6fa31] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:36:25.927077 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-58a8f6d5-b497-495e-82f4-31c8088c05b8 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:25.927535 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-58a8f6d5-b497-495e-82f4-31c8088c05b8 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:25.927879 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-e3d451ca-f3a7-4036-b4f2-8d4d980217d6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:25.928307 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-58a8f6d5-b497-495e-82f4-31c8088c05b8 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:25.928408 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-e3d451ca-f3a7-4036-b4f2-8d4d980217d6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:25.928807 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-58a8f6d5-b497-495e-82f4-31c8088c05b8 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:25.929099 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-e3d451ca-f3a7-4036-b4f2-8d4d980217d6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:25.929538 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-e3d451ca-f3a7-4036-b4f2-8d4d980217d6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:26.068251 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-58a8f6d5-b497-495e-82f4-31c8088c05b8 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:26.076474 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-58a8f6d5-b497-495e-82f4-31c8088c05b8 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/91b69fc3-c7b5-4243-8ee9-47e76d278c8b" status: 200 len: 1681 microversion: 2.1 time: 0.160566 Jun 07 09:36:26.077394 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 416/830] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:36:25 2022] GET /compute/v2.1/servers/91b69fc3-c7b5-4243-8ee9-47e76d278c8b => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:36:26.088808 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-e3d451ca-f3a7-4036-b4f2-8d4d980217d6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:26.103798 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-e3d451ca-f3a7-4036-b4f2-8d4d980217d6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:26.106016 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-e3d451ca-f3a7-4036-b4f2-8d4d980217d6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:26.107960 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-e3d451ca-f3a7-4036-b4f2-8d4d980217d6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31" status: 200 len: 1722 microversion: 2.20 time: 0.190840 Jun 07 09:36:26.108644 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 415/831] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:36:25 2022] GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31 => generated 1722 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 09:36:27.094234 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-ac4384c6-45f9-430b-8289-2a44c6f98473 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:36:27.094957 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-ac4384c6-45f9-430b-8289-2a44c6f98473 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 91b69fc3-c7b5-4243-8ee9-47e76d278c8b] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:36:27.102004 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-ac4384c6-45f9-430b-8289-2a44c6f98473 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:27.102633 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-ac4384c6-45f9-430b-8289-2a44c6f98473 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:27.103726 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-ac4384c6-45f9-430b-8289-2a44c6f98473 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:27.104242 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-ac4384c6-45f9-430b-8289-2a44c6f98473 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:27.131275 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-ecc105ff-3133-479d-ad5c-620ae078d987 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:36:27.131982 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-ecc105ff-3133-479d-ad5c-620ae078d987 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 3cc1496a-defc-48eb-8e12-4b328dd6fa31] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:36:27.137963 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-ecc105ff-3133-479d-ad5c-620ae078d987 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:27.138731 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-ecc105ff-3133-479d-ad5c-620ae078d987 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:27.139690 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-ecc105ff-3133-479d-ad5c-620ae078d987 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:27.140316 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-ecc105ff-3133-479d-ad5c-620ae078d987 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:27.242586 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-ac4384c6-45f9-430b-8289-2a44c6f98473 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:27.251166 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-ac4384c6-45f9-430b-8289-2a44c6f98473 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/91b69fc3-c7b5-4243-8ee9-47e76d278c8b" status: 200 len: 1681 microversion: 2.1 time: 0.161336 Jun 07 09:36:27.251745 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 417/832] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:36:27 2022] GET /compute/v2.1/servers/91b69fc3-c7b5-4243-8ee9-47e76d278c8b => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:36:27.393510 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-ecc105ff-3133-479d-ad5c-620ae078d987 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:27.402058 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-ecc105ff-3133-479d-ad5c-620ae078d987 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:27.404717 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-ecc105ff-3133-479d-ad5c-620ae078d987 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:27.406117 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-ecc105ff-3133-479d-ad5c-620ae078d987 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31" status: 200 len: 1722 microversion: 2.20 time: 0.278745 Jun 07 09:36:27.406665 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 416/833] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:36:27 2022] GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31 => generated 1722 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 09:36:27.860228 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [req-ad468a90-eae8-48bc-abdc-afb27e984609 req-e52e74d6-a2fe-42a6-a635-1b0208efffd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91b69fc3-c7b5-4243-8ee9-47e76d278c8b", "name": "network-vif-deleted", "tag": "d459ab10-7637-47b2-85a4-a5d49c5f63a8"}]} {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:36:27.869949 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [req-ad468a90-eae8-48bc-abdc-afb27e984609 req-e52e74d6-a2fe-42a6-a635-1b0208efffd1 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:27.870514 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [req-ad468a90-eae8-48bc-abdc-afb27e984609 req-e52e74d6-a2fe-42a6-a635-1b0208efffd1 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:27.882147 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.compute.server_external_events [req-ad468a90-eae8-48bc-abdc-afb27e984609 req-e52e74d6-a2fe-42a6-a635-1b0208efffd1 service nova] Creating event network-vif-deleted:d459ab10-7637-47b2-85a4-a5d49c5f63a8 for instance 91b69fc3-c7b5-4243-8ee9-47e76d278c8b on hv-cinder-83699 Jun 07 09:36:27.887181 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [req-ad468a90-eae8-48bc-abdc-afb27e984609 req-e52e74d6-a2fe-42a6-a635-1b0208efffd1 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038488 Jun 07 09:36:27.887804 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 418/834] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Jun 7 09:36:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:36:28.268865 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-e351da3a-7938-4684-b907-e2f2159386fb tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:36:28.269966 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-e351da3a-7938-4684-b907-e2f2159386fb tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 91b69fc3-c7b5-4243-8ee9-47e76d278c8b] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:36:28.277129 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-e351da3a-7938-4684-b907-e2f2159386fb tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:28.284901 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-e351da3a-7938-4684-b907-e2f2159386fb tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:28.284901 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-e351da3a-7938-4684-b907-e2f2159386fb tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:28.284901 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-e351da3a-7938-4684-b907-e2f2159386fb tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:28.318895 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-e351da3a-7938-4684-b907-e2f2159386fb tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:28.319318 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-e351da3a-7938-4684-b907-e2f2159386fb tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:28.319840 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.objects.instance [None req-e351da3a-7938-4684-b907-e2f2159386fb tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lazy-loading 'fault' on Instance uuid 91b69fc3-c7b5-4243-8ee9-47e76d278c8b {{(pid=118741) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 09:36:28.364638 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-e351da3a-7938-4684-b907-e2f2159386fb tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:28.372154 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-e351da3a-7938-4684-b907-e2f2159386fb tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/91b69fc3-c7b5-4243-8ee9-47e76d278c8b" status: 200 len: 1331 microversion: 2.1 time: 0.107458 Jun 07 09:36:28.373404 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 417/835] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:36:28 2022] GET /compute/v2.1/servers/91b69fc3-c7b5-4243-8ee9-47e76d278c8b => generated 1331 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:36:28.427334 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-37956d40-ebcf-4c2f-ae8c-62b6ec9a5ab2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:36:28.428119 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-37956d40-ebcf-4c2f-ae8c-62b6ec9a5ab2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 3cc1496a-defc-48eb-8e12-4b328dd6fa31] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:36:28.434357 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-37956d40-ebcf-4c2f-ae8c-62b6ec9a5ab2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:28.434808 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-37956d40-ebcf-4c2f-ae8c-62b6ec9a5ab2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:28.435578 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-37956d40-ebcf-4c2f-ae8c-62b6ec9a5ab2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:28.436019 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-37956d40-ebcf-4c2f-ae8c-62b6ec9a5ab2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:28.568381 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-37956d40-ebcf-4c2f-ae8c-62b6ec9a5ab2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:28.578895 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-37956d40-ebcf-4c2f-ae8c-62b6ec9a5ab2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:28.580372 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-37956d40-ebcf-4c2f-ae8c-62b6ec9a5ab2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:28.581626 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-37956d40-ebcf-4c2f-ae8c-62b6ec9a5ab2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31" status: 200 len: 1722 microversion: 2.20 time: 0.159120 Jun 07 09:36:28.582418 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 419/836] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:36:28 2022] GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:36:29.395367 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-6c80275b-9052-459f-b48e-86fb280418ad tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:36:29.395906 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-6c80275b-9052-459f-b48e-86fb280418ad tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 91b69fc3-c7b5-4243-8ee9-47e76d278c8b] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:36:29.401832 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-6c80275b-9052-459f-b48e-86fb280418ad tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:29.402272 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-6c80275b-9052-459f-b48e-86fb280418ad tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:29.403016 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-6c80275b-9052-459f-b48e-86fb280418ad tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:29.403472 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-6c80275b-9052-459f-b48e-86fb280418ad tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:29.416718 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.wsgi [None req-6c80275b-9052-459f-b48e-86fb280418ad tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] HTTP exception thrown: Instance 91b69fc3-c7b5-4243-8ee9-47e76d278c8b could not be found. Jun 07 09:36:29.418399 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-6c80275b-9052-459f-b48e-86fb280418ad tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Request method failure captured: Jun 07 09:36:29.418399 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: request: GET /compute/v2.1/servers/91b69fc3-c7b5-4243-8ee9-47e76d278c8b HTTP/1.1 Jun 07 09:36:29.418399 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Accept: application/json Jun 07 09:36:29.418399 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Accept-Encoding: identity Jun 07 09:36:29.418399 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Connection: close Jun 07 09:36:29.418399 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Content-Length: 0 Jun 07 09:36:29.418399 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Content-Type: application/json Jun 07 09:36:29.418399 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Host: 10.222.0.57 Jun 07 09:36:29.418399 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Openstack-System-Scope: None Jun 07 09:36:29.418399 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: User-Agent: python-urllib3/1.26.9 Jun 07 09:36:29.418399 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Auth-Token: gAAAAABinxpC12ZwKTW7QgnAffZ7E-ugoEXrTCPY3mQwE3_vl9PU9oHTK85PZ0XjIngREK5HYB-lK6ouZq5luxAqHs--1L8FlbsFi6dx2RXjuHSwD2ZGE9RoKs0Rdw_R-iFZYNlQhLI_1L8kAsNT9zgLS2ggWur5AvuhEXFMSEICdPE44y32YVk Jun 07 09:36:29.418399 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Domain-Id: None Jun 07 09:36:29.418399 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Domain-Name: None Jun 07 09:36:29.418399 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Identity-Status: Confirmed Jun 07 09:36:29.418399 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Is-Admin-Project: True Jun 07 09:36:29.418399 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Project-Domain-Id: default Jun 07 09:36:29.418399 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Project-Domain-Name: Default Jun 07 09:36:29.418399 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Project-Id: 50189b9cf3b145ba84495af8db63c41b Jun 07 09:36:29.418399 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Project-Name: tempest-AttachVolumeNegativeTest-238843557 Jun 07 09:36:29.418399 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Role: reader,member Jun 07 09:36:29.418399 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Roles: reader,member Jun 07 09:36:29.420307 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/50189b9cf3b145ba84495af8db63c41b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/50189b9cf3b145ba84495af8db63c41b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_50189b9cf3b145ba84495af8db63c41b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/50189b9cf3b145ba84495af8db63c41b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 07 09:36:29.420307 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Tenant: tempest-AttachVolumeNegativeTest-238843557 Jun 07 09:36:29.420307 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Tenant-Id: 50189b9cf3b145ba84495af8db63c41b Jun 07 09:36:29.420307 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-238843557 Jun 07 09:36:29.420307 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User: tempest-AttachVolumeNegativeTest-238843557-project Jun 07 09:36:29.420307 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User-Domain-Id: default Jun 07 09:36:29.420307 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User-Domain-Name: Default Jun 07 09:36:29.420307 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User-Id: 2f32356bb0bd4234ba817db581b62aad Jun 07 09:36:29.420307 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User-Name: tempest-AttachVolumeNegativeTest-238843557-project Jun 07 09:36:29.420307 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: method: > Jun 07 09:36:29.420307 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: exception: Instance 91b69fc3-c7b5-4243-8ee9-47e76d278c8b could not be found. Jun 07 09:36:29.420307 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: action_args: {'id': '91b69fc3-c7b5-4243-8ee9-47e76d278c8b'} Jun 07 09:36:29.421601 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 09:36:29.421601 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:36:29.421601 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 09:36:29.421601 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 09:36:29.421601 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 09:36:29.421601 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 09:36:29.421601 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 09:36:29.421601 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 09:36:29.421601 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 09:36:29.421601 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 09:36:29.421601 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91b69fc3-c7b5-4243-8ee9-47e76d278c8b could not be found. Jun 07 09:36:29.421601 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:36:29.421601 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:36:29.421601 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:36:29.421601 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:36:29.421601 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:36:29.421601 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:36:29.421601 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 09:36:29.421601 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 09:36:29.421601 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 09:36:29.427312 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 09:36:29.427312 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 09:36:29.427312 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 09:36:29.427312 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 09:36:29.427312 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 09:36:29.427312 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 09:36:29.427312 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 09:36:29.427312 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91b69fc3-c7b5-4243-8ee9-47e76d278c8b could not be found. Jun 07 09:36:29.427312 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:36:29.427312 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:36:29.427312 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:36:29.427312 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:36:29.427312 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:36:29.427312 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:36:29.427312 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 09:36:29.427312 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 09:36:29.427312 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91b69fc3-c7b5-4243-8ee9-47e76d278c8b could not be found. Jun 07 09:36:29.427312 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:36:29.428823 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-6c80275b-9052-459f-b48e-86fb280418ad tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Returning 404 to user: Instance 91b69fc3-c7b5-4243-8ee9-47e76d278c8b could not be found. {{(pid=118741) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 09:36:29.428823 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-6c80275b-9052-459f-b48e-86fb280418ad tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/91b69fc3-c7b5-4243-8ee9-47e76d278c8b" status: 404 len: 111 microversion: 2.1 time: 0.028347 Jun 07 09:36:29.428823 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 418/837] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:36:29 2022] GET /compute/v2.1/servers/91b69fc3-c7b5-4243-8ee9-47e76d278c8b => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 09:36:29.432346 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-566eee07-07d1-4bfb-8a31-2a914a7ade74 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '.version_select at 0x7f5c91d57280>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:36:29.533489 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-566eee07-07d1-4bfb-8a31-2a914a7ade74 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1106376749" status: 202 len: 0 microversion: 2.1 time: 0.107592 Jun 07 09:36:29.534513 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 420/838] 10.222.0.57 () {58 vars in 1220 bytes} [Tue Jun 7 09:36:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1106376749 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 09:36:29.601189 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-93e89074-29c8-44e1-88e5-fccd6991acbb tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:36:29.602064 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-93e89074-29c8-44e1-88e5-fccd6991acbb tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 3cc1496a-defc-48eb-8e12-4b328dd6fa31] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:36:29.609379 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-93e89074-29c8-44e1-88e5-fccd6991acbb tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:29.609946 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-93e89074-29c8-44e1-88e5-fccd6991acbb tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:29.610816 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-93e89074-29c8-44e1-88e5-fccd6991acbb tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:29.611359 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-93e89074-29c8-44e1-88e5-fccd6991acbb tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:29.841612 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-93e89074-29c8-44e1-88e5-fccd6991acbb tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:29.849730 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-93e89074-29c8-44e1-88e5-fccd6991acbb tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:29.851460 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-93e89074-29c8-44e1-88e5-fccd6991acbb tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:29.852635 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-93e89074-29c8-44e1-88e5-fccd6991acbb tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31" status: 200 len: 1722 microversion: 2.20 time: 0.255485 Jun 07 09:36:29.853438 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 419/839] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:36:29 2022] GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31 => generated 1722 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:36:30.325645 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-bb1dfea0-43e8-43ab-957c-341464a0c29f tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Action: 'create', calling method: .version_select at 0x7f5c91e5f1f0>, body: {"keypair": {"name": "tempest-keypair-675283852", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKX5h1yqXdu9dudJ5ZgaUcg2f6LpJSqSlbYOioox9VUqAvbL1yFV9OtgH8kPeJFuzbO4+hTNaMWgyIc2vqWcvF34OTy63XoCiO7TgIBTAYznjqJhiGHKgplbXulEEF3tHQ=="}} {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:36:30.340349 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.quota [None req-bb1dfea0-43e8-43ab-957c-341464a0c29f tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Getting quotas for project 50189b9cf3b145ba84495af8db63c41b. Resources: {'key_pairs'} {{(pid=118740) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 09:36:30.344438 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.quota [None req-bb1dfea0-43e8-43ab-957c-341464a0c29f tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Getting quotas for user 2f32356bb0bd4234ba817db581b62aad and project 50189b9cf3b145ba84495af8db63c41b. Resources: {'key_pairs'} {{(pid=118740) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 09:36:30.459144 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-bb1dfea0-43e8-43ab-957c-341464a0c29f tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.137440 Jun 07 09:36:30.459976 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 421/840] 10.222.0.57 () {60 vars in 1158 bytes} [Tue Jun 7 09:36:30 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:36:30.872611 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-b73da023-e518-4aba-b1c9-a286b43eff90 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:36:30.873230 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-b73da023-e518-4aba-b1c9-a286b43eff90 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 3cc1496a-defc-48eb-8e12-4b328dd6fa31] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:36:30.879229 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b73da023-e518-4aba-b1c9-a286b43eff90 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:30.879673 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b73da023-e518-4aba-b1c9-a286b43eff90 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:30.880442 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b73da023-e518-4aba-b1c9-a286b43eff90 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:30.881529 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b73da023-e518-4aba-b1c9-a286b43eff90 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:31.014263 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-b73da023-e518-4aba-b1c9-a286b43eff90 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:31.022862 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-b73da023-e518-4aba-b1c9-a286b43eff90 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:31.024360 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-b73da023-e518-4aba-b1c9-a286b43eff90 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:31.025547 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-b73da023-e518-4aba-b1c9-a286b43eff90 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31" status: 200 len: 1722 microversion: 2.20 time: 0.157167 Jun 07 09:36:31.026097 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 420/841] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:36:30 2022] GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:36:32.047224 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-adb0c043-01bf-4e80-9502-b6a4457fc1e3 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:36:32.047971 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-adb0c043-01bf-4e80-9502-b6a4457fc1e3 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 3cc1496a-defc-48eb-8e12-4b328dd6fa31] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:36:32.055838 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-adb0c043-01bf-4e80-9502-b6a4457fc1e3 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:32.056614 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-adb0c043-01bf-4e80-9502-b6a4457fc1e3 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:32.057436 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-adb0c043-01bf-4e80-9502-b6a4457fc1e3 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:32.057876 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-adb0c043-01bf-4e80-9502-b6a4457fc1e3 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:32.209334 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-adb0c043-01bf-4e80-9502-b6a4457fc1e3 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:32.217343 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-adb0c043-01bf-4e80-9502-b6a4457fc1e3 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:32.218861 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-adb0c043-01bf-4e80-9502-b6a4457fc1e3 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:32.220050 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-adb0c043-01bf-4e80-9502-b6a4457fc1e3 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31" status: 200 len: 1722 microversion: 2.20 time: 0.180562 Jun 07 09:36:32.220621 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 422/842] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:36:32 2022] GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31 => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:36:32.864924 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-6425856e-b4d8-4307-9d8c-c1d527a44ca2 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1190916531", "imageRef": "8fdb0275-8c58-4c9e-a2f3-3aae3a947526", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1c3e2e81-e169-4afa-8693-c0d0a9ba7610"}], "security_groups": [{"name": "tempest-securitygroup--1652310768"}], "key_name": "tempest-keypair-675283852", "user_data": "}} {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:36:32.966924 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.network.neutron [None req-6425856e-b4d8-4307-9d8c-c1d527a44ca2 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] validate_networks() for [('1c3e2e81-e169-4afa-8693-c0d0a9ba7610', None, None, None, None, None)] {{(pid=118741) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 09:36:33.239103 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-fc59bc9d-17b4-4264-a3c4-1f1de69d0cc6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:36:33.239750 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-fc59bc9d-17b4-4264-a3c4-1f1de69d0cc6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 3cc1496a-defc-48eb-8e12-4b328dd6fa31] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:36:33.246408 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-fc59bc9d-17b4-4264-a3c4-1f1de69d0cc6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:33.255718 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-fc59bc9d-17b4-4264-a3c4-1f1de69d0cc6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:33.255718 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-fc59bc9d-17b4-4264-a3c4-1f1de69d0cc6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:33.255718 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-fc59bc9d-17b4-4264-a3c4-1f1de69d0cc6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:33.339276 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.virt.hardware [None req-6425856e-b4d8-4307-9d8c-c1d527a44ca2 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Flavor limits 0:0:0 {{(pid=118741) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 09:36:33.339857 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.virt.hardware [None req-6425856e-b4d8-4307-9d8c-c1d527a44ca2 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Image limits 0:0:0 {{(pid=118741) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 09:36:33.340497 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.virt.hardware [None req-6425856e-b4d8-4307-9d8c-c1d527a44ca2 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Flavor pref 0:0:0 {{(pid=118741) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 09:36:33.341144 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.virt.hardware [None req-6425856e-b4d8-4307-9d8c-c1d527a44ca2 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Image pref 0:0:0 {{(pid=118741) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 09:36:33.342231 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.virt.hardware [None req-6425856e-b4d8-4307-9d8c-c1d527a44ca2 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118741) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 09:36:33.351217 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-6425856e-b4d8-4307-9d8c-c1d527a44ca2 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:33.351747 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-6425856e-b4d8-4307-9d8c-c1d527a44ca2 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:33.352882 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-6425856e-b4d8-4307-9d8c-c1d527a44ca2 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:33.353396 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-6425856e-b4d8-4307-9d8c-c1d527a44ca2 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:33.370513 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.quota [None req-6425856e-b4d8-4307-9d8c-c1d527a44ca2 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Getting quotas for project 50189b9cf3b145ba84495af8db63c41b. Resources: {'instances', 'cores', 'ram'} {{(pid=118741) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 09:36:33.374496 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.quota [None req-6425856e-b4d8-4307-9d8c-c1d527a44ca2 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Getting quotas for user 2f32356bb0bd4234ba817db581b62aad and project 50189b9cf3b145ba84495af8db63c41b. Resources: {'instances', 'cores', 'ram'} {{(pid=118741) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 09:36:33.381942 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-fc59bc9d-17b4-4264-a3c4-1f1de69d0cc6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:33.385380 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-6425856e-b4d8-4307-9d8c-c1d527a44ca2 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Going to run 1 instances... {{(pid=118741) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 09:36:33.387775 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-6425856e-b4d8-4307-9d8c-c1d527a44ca2 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 99a619a0-6d18-47e7-bbdf-811c2949405d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8fdb0275-8c58-4c9e-a2f3-3aae3a947526',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118741) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 09:36:33.390685 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-fc59bc9d-17b4-4264-a3c4-1f1de69d0cc6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:33.392241 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-fc59bc9d-17b4-4264-a3c4-1f1de69d0cc6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:33.393487 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-fc59bc9d-17b4-4264-a3c4-1f1de69d0cc6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31" status: 200 len: 1722 microversion: 2.20 time: 0.158389 Jun 07 09:36:33.394058 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 423/843] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:36:33 2022] GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 09:36:33.569162 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-6425856e-b4d8-4307-9d8c-c1d527a44ca2 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.708503 Jun 07 09:36:33.569721 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 421/844] 10.222.0.57 () {60 vars in 1146 bytes} [Tue Jun 7 09:36:32 2022] POST /compute/v2.1/servers => generated 402 bytes in 710 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 09:36:33.580008 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-a1334fcf-2f75-48e5-a2fe-aec3e8dab1f8 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:36:33.580633 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-a1334fcf-2f75-48e5-a2fe-aec3e8dab1f8 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 99a619a0-6d18-47e7-bbdf-811c2949405d] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:36:33.635111 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-a1334fcf-2f75-48e5-a2fe-aec3e8dab1f8 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:33.643308 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-a1334fcf-2f75-48e5-a2fe-aec3e8dab1f8 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/99a619a0-6d18-47e7-bbdf-811c2949405d" status: 200 len: 1241 microversion: 2.1 time: 0.067475 Jun 07 09:36:33.645777 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 424/845] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:36:33 2022] GET /compute/v2.1/servers/99a619a0-6d18-47e7-bbdf-811c2949405d => generated 1241 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:36:34.412494 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-b6ea77da-c4d8-4980-b32c-ad9e4e7ff46a tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:36:34.413046 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-b6ea77da-c4d8-4980-b32c-ad9e4e7ff46a tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 3cc1496a-defc-48eb-8e12-4b328dd6fa31] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:36:34.419192 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b6ea77da-c4d8-4980-b32c-ad9e4e7ff46a tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:34.420146 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b6ea77da-c4d8-4980-b32c-ad9e4e7ff46a tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:34.420964 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b6ea77da-c4d8-4980-b32c-ad9e4e7ff46a tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:34.421392 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b6ea77da-c4d8-4980-b32c-ad9e4e7ff46a tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:34.552308 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-b6ea77da-c4d8-4980-b32c-ad9e4e7ff46a tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:34.560432 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-b6ea77da-c4d8-4980-b32c-ad9e4e7ff46a tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:34.561956 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-b6ea77da-c4d8-4980-b32c-ad9e4e7ff46a tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:34.563101 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-b6ea77da-c4d8-4980-b32c-ad9e4e7ff46a tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31" status: 200 len: 1722 microversion: 2.20 time: 0.154705 Jun 07 09:36:34.563654 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 422/846] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:36:34 2022] GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:36:34.659698 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-a65641ac-2a9a-409f-8810-a60ed32a63f5 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:36:34.660349 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-a65641ac-2a9a-409f-8810-a60ed32a63f5 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 99a619a0-6d18-47e7-bbdf-811c2949405d] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:36:34.667613 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-a65641ac-2a9a-409f-8810-a60ed32a63f5 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:34.668075 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-a65641ac-2a9a-409f-8810-a60ed32a63f5 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:34.668895 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-a65641ac-2a9a-409f-8810-a60ed32a63f5 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:34.669902 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-a65641ac-2a9a-409f-8810-a60ed32a63f5 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:34.735020 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-a65641ac-2a9a-409f-8810-a60ed32a63f5 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:34.742664 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-a65641ac-2a9a-409f-8810-a60ed32a63f5 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/99a619a0-6d18-47e7-bbdf-811c2949405d" status: 200 len: 1245 microversion: 2.1 time: 0.086871 Jun 07 09:36:34.743229 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 425/847] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:36:34 2022] GET /compute/v2.1/servers/99a619a0-6d18-47e7-bbdf-811c2949405d => generated 1245 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:36:35.580766 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-0f8403e3-29ae-48fa-9fa1-7ab48b9b6259 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:36:35.581360 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-0f8403e3-29ae-48fa-9fa1-7ab48b9b6259 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 3cc1496a-defc-48eb-8e12-4b328dd6fa31] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:36:35.587429 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-0f8403e3-29ae-48fa-9fa1-7ab48b9b6259 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:35.587871 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-0f8403e3-29ae-48fa-9fa1-7ab48b9b6259 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:35.588646 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-0f8403e3-29ae-48fa-9fa1-7ab48b9b6259 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:35.589079 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-0f8403e3-29ae-48fa-9fa1-7ab48b9b6259 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:35.593105 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:36:35.759571 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-450d4be7-7425-4179-b089-c4098ff1f754 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:36:35.760448 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-450d4be7-7425-4179-b089-c4098ff1f754 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 99a619a0-6d18-47e7-bbdf-811c2949405d] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:36:35.767387 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-450d4be7-7425-4179-b089-c4098ff1f754 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:35.768421 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-450d4be7-7425-4179-b089-c4098ff1f754 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:35.769316 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-450d4be7-7425-4179-b089-c4098ff1f754 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:35.769750 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-450d4be7-7425-4179-b089-c4098ff1f754 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:35.815075 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-0f8403e3-29ae-48fa-9fa1-7ab48b9b6259 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:35.823360 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-0f8403e3-29ae-48fa-9fa1-7ab48b9b6259 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:35.827769 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-0f8403e3-29ae-48fa-9fa1-7ab48b9b6259 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:35.827769 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-0f8403e3-29ae-48fa-9fa1-7ab48b9b6259 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31" status: 200 len: 1722 microversion: 2.20 time: 0.249168 Jun 07 09:36:35.827769 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 423/848] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:36:35 2022] GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31 => generated 1722 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:36:35.839857 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-450d4be7-7425-4179-b089-c4098ff1f754 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:35.847419 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-450d4be7-7425-4179-b089-c4098ff1f754 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/99a619a0-6d18-47e7-bbdf-811c2949405d" status: 200 len: 1301 microversion: 2.1 time: 0.091829 Jun 07 09:36:35.848053 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 426/849] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:36:35 2022] GET /compute/v2.1/servers/99a619a0-6d18-47e7-bbdf-811c2949405d => generated 1301 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:36:36.843719 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-827e4ab7-7b08-484a-b107-c048f1581c1f tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:36:36.844367 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-827e4ab7-7b08-484a-b107-c048f1581c1f tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 3cc1496a-defc-48eb-8e12-4b328dd6fa31] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:36:36.852121 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-827e4ab7-7b08-484a-b107-c048f1581c1f tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:36.852485 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-827e4ab7-7b08-484a-b107-c048f1581c1f tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:36.853552 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-827e4ab7-7b08-484a-b107-c048f1581c1f tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:36.853987 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-827e4ab7-7b08-484a-b107-c048f1581c1f tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:36.865719 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-322b7108-f044-4854-aa86-50f0a169debf tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:36:36.866563 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-322b7108-f044-4854-aa86-50f0a169debf tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 99a619a0-6d18-47e7-bbdf-811c2949405d] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:36:36.873879 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-322b7108-f044-4854-aa86-50f0a169debf tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:36.874333 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-322b7108-f044-4854-aa86-50f0a169debf tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:36.875171 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-322b7108-f044-4854-aa86-50f0a169debf tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:36.875595 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-322b7108-f044-4854-aa86-50f0a169debf tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:37.012807 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-322b7108-f044-4854-aa86-50f0a169debf tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:37.022405 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-322b7108-f044-4854-aa86-50f0a169debf tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/99a619a0-6d18-47e7-bbdf-811c2949405d" status: 200 len: 1367 microversion: 2.1 time: 0.160720 Jun 07 09:36:37.022963 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 427/850] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:36:36 2022] GET /compute/v2.1/servers/99a619a0-6d18-47e7-bbdf-811c2949405d => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:36:37.068248 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-827e4ab7-7b08-484a-b107-c048f1581c1f tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:37.077514 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-827e4ab7-7b08-484a-b107-c048f1581c1f tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:37.079147 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-827e4ab7-7b08-484a-b107-c048f1581c1f tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:37.080300 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-827e4ab7-7b08-484a-b107-c048f1581c1f tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31" status: 200 len: 1722 microversion: 2.20 time: 0.240966 Jun 07 09:36:37.080925 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 424/851] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:36:36 2022] GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31 => generated 1722 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:36:37.641974 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [req-c2fa5302-fe34-4d2a-8f14-c20ed3fb282c req-a20d36c4-7dc0-4d2e-aeb5-423f56c6f85e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99a619a0-6d18-47e7-bbdf-811c2949405d", "tag": "de7081e5-144c-4179-9018-1cdedceee805"}]} {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:36:37.651793 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [req-c2fa5302-fe34-4d2a-8f14-c20ed3fb282c req-a20d36c4-7dc0-4d2e-aeb5-423f56c6f85e service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:37.652281 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [req-c2fa5302-fe34-4d2a-8f14-c20ed3fb282c req-a20d36c4-7dc0-4d2e-aeb5-423f56c6f85e service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:37.664214 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.compute.server_external_events [req-c2fa5302-fe34-4d2a-8f14-c20ed3fb282c req-a20d36c4-7dc0-4d2e-aeb5-423f56c6f85e service nova] Creating event network-changed:de7081e5-144c-4179-9018-1cdedceee805 for instance 99a619a0-6d18-47e7-bbdf-811c2949405d on hv-cinder-83699 Jun 07 09:36:37.677432 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [req-c2fa5302-fe34-4d2a-8f14-c20ed3fb282c req-a20d36c4-7dc0-4d2e-aeb5-423f56c6f85e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032164 Jun 07 09:36:37.677432 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 428/852] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Jun 7 09:36:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:36:38.039691 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-20df086c-47af-4917-835b-48a46a0ba1b1 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:36:38.040305 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-20df086c-47af-4917-835b-48a46a0ba1b1 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 99a619a0-6d18-47e7-bbdf-811c2949405d] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:36:38.047650 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-20df086c-47af-4917-835b-48a46a0ba1b1 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:38.048099 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-20df086c-47af-4917-835b-48a46a0ba1b1 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:38.048899 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-20df086c-47af-4917-835b-48a46a0ba1b1 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:38.049471 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-20df086c-47af-4917-835b-48a46a0ba1b1 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:38.099410 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-262ae3bc-afcb-4b16-be72-f5eb8565b7a7 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:36:38.100239 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-262ae3bc-afcb-4b16-be72-f5eb8565b7a7 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 3cc1496a-defc-48eb-8e12-4b328dd6fa31] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:36:38.107249 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-262ae3bc-afcb-4b16-be72-f5eb8565b7a7 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:38.109918 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-262ae3bc-afcb-4b16-be72-f5eb8565b7a7 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:38.109918 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-262ae3bc-afcb-4b16-be72-f5eb8565b7a7 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:38.109918 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-262ae3bc-afcb-4b16-be72-f5eb8565b7a7 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:38.251266 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-20df086c-47af-4917-835b-48a46a0ba1b1 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:38.251851 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-262ae3bc-afcb-4b16-be72-f5eb8565b7a7 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:38.263957 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-20df086c-47af-4917-835b-48a46a0ba1b1 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/99a619a0-6d18-47e7-bbdf-811c2949405d" status: 200 len: 1367 microversion: 2.1 time: 0.228220 Jun 07 09:36:38.276761 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-262ae3bc-afcb-4b16-be72-f5eb8565b7a7 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:38.276919 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 425/853] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:36:38 2022] GET /compute/v2.1/servers/99a619a0-6d18-47e7-bbdf-811c2949405d => generated 1367 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:36:38.277007 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-262ae3bc-afcb-4b16-be72-f5eb8565b7a7 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:38.277007 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-262ae3bc-afcb-4b16-be72-f5eb8565b7a7 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31" status: 200 len: 1743 microversion: 2.20 time: 0.172555 Jun 07 09:36:38.277805 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 429/854] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:36:38 2022] GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31 => generated 1743 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 09:36:39.280921 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-81add4a5-7ba0-4c8e-afbc-e819d2a0db9a tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:36:39.281524 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-81add4a5-7ba0-4c8e-afbc-e819d2a0db9a tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 99a619a0-6d18-47e7-bbdf-811c2949405d] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:36:39.286004 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-fd8e1b70-418f-41d3-87e1-bc7a7760ae43 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:36:39.286639 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-fd8e1b70-418f-41d3-87e1-bc7a7760ae43 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 3cc1496a-defc-48eb-8e12-4b328dd6fa31] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:36:39.287626 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-81add4a5-7ba0-4c8e-afbc-e819d2a0db9a tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:39.288070 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-81add4a5-7ba0-4c8e-afbc-e819d2a0db9a tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:39.288846 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-81add4a5-7ba0-4c8e-afbc-e819d2a0db9a tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:39.289274 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-81add4a5-7ba0-4c8e-afbc-e819d2a0db9a tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:39.294244 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-fd8e1b70-418f-41d3-87e1-bc7a7760ae43 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:39.294244 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-fd8e1b70-418f-41d3-87e1-bc7a7760ae43 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:39.294244 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-fd8e1b70-418f-41d3-87e1-bc7a7760ae43 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:39.294612 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-fd8e1b70-418f-41d3-87e1-bc7a7760ae43 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:39.298826 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:36:39.420380 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-81add4a5-7ba0-4c8e-afbc-e819d2a0db9a tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:39.424476 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-fd8e1b70-418f-41d3-87e1-bc7a7760ae43 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:39.427879 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-81add4a5-7ba0-4c8e-afbc-e819d2a0db9a tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/99a619a0-6d18-47e7-bbdf-811c2949405d" status: 200 len: 1367 microversion: 2.1 time: 0.151389 Jun 07 09:36:39.428446 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 426/855] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:36:39 2022] GET /compute/v2.1/servers/99a619a0-6d18-47e7-bbdf-811c2949405d => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:36:39.432809 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-fd8e1b70-418f-41d3-87e1-bc7a7760ae43 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:39.434395 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-fd8e1b70-418f-41d3-87e1-bc7a7760ae43 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:39.435660 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-fd8e1b70-418f-41d3-87e1-bc7a7760ae43 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31" status: 200 len: 1743 microversion: 2.20 time: 0.153533 Jun 07 09:36:39.436279 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 430/856] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:36:39 2022] GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31 => generated 1743 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 09:36:40.444756 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-830f274e-a83e-443b-b2a6-334d2e0683ca tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:36:40.445400 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-830f274e-a83e-443b-b2a6-334d2e0683ca tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 99a619a0-6d18-47e7-bbdf-811c2949405d] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:36:40.451516 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-830f274e-a83e-443b-b2a6-334d2e0683ca tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:40.451961 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-830f274e-a83e-443b-b2a6-334d2e0683ca tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:40.452750 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-830f274e-a83e-443b-b2a6-334d2e0683ca tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:40.453187 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-830f274e-a83e-443b-b2a6-334d2e0683ca tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:40.453637 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-f217370c-c1c4-485b-b71f-38986beb39a2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:36:40.454254 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-f217370c-c1c4-485b-b71f-38986beb39a2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 3cc1496a-defc-48eb-8e12-4b328dd6fa31] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:36:40.460747 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-f217370c-c1c4-485b-b71f-38986beb39a2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:40.461203 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-f217370c-c1c4-485b-b71f-38986beb39a2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:40.461970 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-f217370c-c1c4-485b-b71f-38986beb39a2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:40.462418 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-f217370c-c1c4-485b-b71f-38986beb39a2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:40.589499 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-830f274e-a83e-443b-b2a6-334d2e0683ca tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:40.596153 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-f217370c-c1c4-485b-b71f-38986beb39a2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:40.603668 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-830f274e-a83e-443b-b2a6-334d2e0683ca tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/99a619a0-6d18-47e7-bbdf-811c2949405d" status: 200 len: 1367 microversion: 2.1 time: 0.162789 Jun 07 09:36:40.604550 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 427/857] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:36:40 2022] GET /compute/v2.1/servers/99a619a0-6d18-47e7-bbdf-811c2949405d => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:36:40.604840 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-f217370c-c1c4-485b-b71f-38986beb39a2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:40.607250 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-f217370c-c1c4-485b-b71f-38986beb39a2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:40.608729 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-f217370c-c1c4-485b-b71f-38986beb39a2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31" status: 200 len: 1743 microversion: 2.20 time: 0.158784 Jun 07 09:36:40.609282 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 431/858] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:36:40 2022] GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31 => generated 1743 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 09:36:41.620942 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-575ff51b-c54a-4f29-a0c2-498426f48fe1 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:36:41.621554 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-575ff51b-c54a-4f29-a0c2-498426f48fe1 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 99a619a0-6d18-47e7-bbdf-811c2949405d] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:36:41.627328 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-822fdccd-2cc7-428d-860b-7f42abb6de38 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:36:41.627945 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-822fdccd-2cc7-428d-860b-7f42abb6de38 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 3cc1496a-defc-48eb-8e12-4b328dd6fa31] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:36:41.628329 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-575ff51b-c54a-4f29-a0c2-498426f48fe1 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:41.628820 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-575ff51b-c54a-4f29-a0c2-498426f48fe1 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:41.629583 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-575ff51b-c54a-4f29-a0c2-498426f48fe1 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:41.630018 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-575ff51b-c54a-4f29-a0c2-498426f48fe1 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:41.634349 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-822fdccd-2cc7-428d-860b-7f42abb6de38 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:41.634804 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-822fdccd-2cc7-428d-860b-7f42abb6de38 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:41.635574 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-822fdccd-2cc7-428d-860b-7f42abb6de38 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:41.636015 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-822fdccd-2cc7-428d-860b-7f42abb6de38 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:41.756716 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-575ff51b-c54a-4f29-a0c2-498426f48fe1 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:41.763072 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-822fdccd-2cc7-428d-860b-7f42abb6de38 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:41.764505 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-575ff51b-c54a-4f29-a0c2-498426f48fe1 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/99a619a0-6d18-47e7-bbdf-811c2949405d" status: 200 len: 1367 microversion: 2.1 time: 0.147209 Jun 07 09:36:41.765151 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 428/859] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:36:41 2022] GET /compute/v2.1/servers/99a619a0-6d18-47e7-bbdf-811c2949405d => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:36:41.771175 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-822fdccd-2cc7-428d-860b-7f42abb6de38 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:41.772753 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-822fdccd-2cc7-428d-860b-7f42abb6de38 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:41.773913 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-822fdccd-2cc7-428d-860b-7f42abb6de38 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31" status: 200 len: 1743 microversion: 2.20 time: 0.150530 Jun 07 09:36:41.774464 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 432/860] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:36:41 2022] GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31 => generated 1743 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:36:41.997788 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [req-2fc0abd6-1074-4b09-bec2-6679c34ab9bd req-f3761dc6-57e8-44a1-b56f-4b518d17b4ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cc1496a-defc-48eb-8e12-4b328dd6fa31", "name": "network-vif-plugged", "status": "completed", "tag": "f987791d-1369-4164-867a-29c6d0558f0c"}]} {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:36:42.007527 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [req-2fc0abd6-1074-4b09-bec2-6679c34ab9bd req-f3761dc6-57e8-44a1-b56f-4b518d17b4ae service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:42.007527 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [req-2fc0abd6-1074-4b09-bec2-6679c34ab9bd req-f3761dc6-57e8-44a1-b56f-4b518d17b4ae service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:42.017705 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.compute.server_external_events [req-2fc0abd6-1074-4b09-bec2-6679c34ab9bd req-f3761dc6-57e8-44a1-b56f-4b518d17b4ae service nova] Creating event network-vif-plugged:f987791d-1369-4164-867a-29c6d0558f0c for instance 3cc1496a-defc-48eb-8e12-4b328dd6fa31 on hv-cinder-83699 Jun 07 09:36:42.022731 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [req-2fc0abd6-1074-4b09-bec2-6679c34ab9bd req-f3761dc6-57e8-44a1-b56f-4b518d17b4ae service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028644 Jun 07 09:36:42.023314 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 429/861] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Jun 7 09:36:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:36:42.782020 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-cacc53c3-08bb-4228-806f-b631b4f31094 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:36:42.782670 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-cacc53c3-08bb-4228-806f-b631b4f31094 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 99a619a0-6d18-47e7-bbdf-811c2949405d] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:36:42.784950 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writing DB stats nova_api:SELECT=57,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:36:42.789784 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-cacc53c3-08bb-4228-806f-b631b4f31094 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:42.790229 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-cacc53c3-08bb-4228-806f-b631b4f31094 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:42.790993 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-cacc53c3-08bb-4228-806f-b631b4f31094 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:42.791424 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-cacc53c3-08bb-4228-806f-b631b4f31094 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:42.791667 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-ab817ada-536f-4cfe-98c5-aed191af19a3 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:36:42.792368 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-ab817ada-536f-4cfe-98c5-aed191af19a3 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 3cc1496a-defc-48eb-8e12-4b328dd6fa31] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:36:42.799428 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-ab817ada-536f-4cfe-98c5-aed191af19a3 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:42.802856 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-ab817ada-536f-4cfe-98c5-aed191af19a3 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:42.802856 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-ab817ada-536f-4cfe-98c5-aed191af19a3 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:42.802856 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-ab817ada-536f-4cfe-98c5-aed191af19a3 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:42.921844 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-cacc53c3-08bb-4228-806f-b631b4f31094 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:42.929420 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-cacc53c3-08bb-4228-806f-b631b4f31094 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/99a619a0-6d18-47e7-bbdf-811c2949405d" status: 200 len: 1367 microversion: 2.1 time: 0.151809 Jun 07 09:36:42.930039 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 433/862] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:36:42 2022] GET /compute/v2.1/servers/99a619a0-6d18-47e7-bbdf-811c2949405d => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:36:42.932371 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-ab817ada-536f-4cfe-98c5-aed191af19a3 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:42.940265 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-ab817ada-536f-4cfe-98c5-aed191af19a3 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:42.941783 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-ab817ada-536f-4cfe-98c5-aed191af19a3 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:42.942925 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-ab817ada-536f-4cfe-98c5-aed191af19a3 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31" status: 200 len: 1743 microversion: 2.20 time: 0.155628 Jun 07 09:36:42.943468 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 430/863] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:36:42 2022] GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31 => generated 1743 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 09:36:43.946815 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-abb3086c-fa6a-4dc8-8ccd-bb70816229a6 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:36:43.947335 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-abb3086c-fa6a-4dc8-8ccd-bb70816229a6 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 99a619a0-6d18-47e7-bbdf-811c2949405d] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:36:43.949222 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writing DB stats nova_cell0:SELECT=6 {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:36:43.955003 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-abb3086c-fa6a-4dc8-8ccd-bb70816229a6 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:43.955442 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-abb3086c-fa6a-4dc8-8ccd-bb70816229a6 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:43.956268 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-abb3086c-fa6a-4dc8-8ccd-bb70816229a6 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:43.956746 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-abb3086c-fa6a-4dc8-8ccd-bb70816229a6 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:43.961805 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-353eb659-b883-4b64-91c8-db2a65583ab5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:36:43.971166 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-353eb659-b883-4b64-91c8-db2a65583ab5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 3cc1496a-defc-48eb-8e12-4b328dd6fa31] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:36:43.971166 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writing DB stats nova_cell0:SELECT=2 {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:36:43.971166 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writing DB stats nova_cell0:SELECT=6 {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:36:43.971703 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-353eb659-b883-4b64-91c8-db2a65583ab5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:43.972089 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-353eb659-b883-4b64-91c8-db2a65583ab5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:43.972897 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-353eb659-b883-4b64-91c8-db2a65583ab5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:43.973331 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-353eb659-b883-4b64-91c8-db2a65583ab5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:44.099641 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-abb3086c-fa6a-4dc8-8ccd-bb70816229a6 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:44.107566 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-abb3086c-fa6a-4dc8-8ccd-bb70816229a6 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/99a619a0-6d18-47e7-bbdf-811c2949405d" status: 200 len: 1367 microversion: 2.1 time: 0.165155 Jun 07 09:36:44.108133 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 434/864] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:36:43 2022] GET /compute/v2.1/servers/99a619a0-6d18-47e7-bbdf-811c2949405d => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:36:44.118235 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-353eb659-b883-4b64-91c8-db2a65583ab5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:44.126481 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-353eb659-b883-4b64-91c8-db2a65583ab5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:44.128021 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-353eb659-b883-4b64-91c8-db2a65583ab5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:44.129216 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-353eb659-b883-4b64-91c8-db2a65583ab5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31" status: 200 len: 1743 microversion: 2.20 time: 0.171811 Jun 07 09:36:44.129956 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 431/865] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:36:43 2022] GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31 => generated 1743 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 09:36:45.044186 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-b495fa09-237d-45ee-80fc-69bd5674a65d tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:36:45.044702 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-b495fa09-237d-45ee-80fc-69bd5674a65d tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 51d3266a-292e-4fce-a594-e8cbda085c6e] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:36:45.051647 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b495fa09-237d-45ee-80fc-69bd5674a65d tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:45.052094 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b495fa09-237d-45ee-80fc-69bd5674a65d tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:45.052886 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b495fa09-237d-45ee-80fc-69bd5674a65d tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:45.053323 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b495fa09-237d-45ee-80fc-69bd5674a65d tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:45.075303 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-b495fa09-237d-45ee-80fc-69bd5674a65d tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/51d3266a-292e-4fce-a594-e8cbda085c6e/ips" status: 200 len: 145 microversion: 2.1 time: 0.035085 Jun 07 09:36:45.075854 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 435/866] 10.222.0.57 () {58 vars in 1247 bytes} [Tue Jun 7 09:36:45 2022] GET /compute/v2.1/servers/51d3266a-292e-4fce-a594-e8cbda085c6e/ips => generated 145 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:36:45.124710 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-eecb966b-bf59-4649-8f6f-d60a98bcc2e4 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:36:45.125316 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-eecb966b-bf59-4649-8f6f-d60a98bcc2e4 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 99a619a0-6d18-47e7-bbdf-811c2949405d] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:36:45.131354 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-eecb966b-bf59-4649-8f6f-d60a98bcc2e4 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:45.131793 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-eecb966b-bf59-4649-8f6f-d60a98bcc2e4 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:45.132542 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-eecb966b-bf59-4649-8f6f-d60a98bcc2e4 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:45.132994 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-eecb966b-bf59-4649-8f6f-d60a98bcc2e4 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:45.148336 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-73e75c96-cd6b-4fc7-9a51-1fa36470a614 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:36:45.149171 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-73e75c96-cd6b-4fc7-9a51-1fa36470a614 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 3cc1496a-defc-48eb-8e12-4b328dd6fa31] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:36:45.155728 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-73e75c96-cd6b-4fc7-9a51-1fa36470a614 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:45.156183 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-73e75c96-cd6b-4fc7-9a51-1fa36470a614 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:45.157035 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-73e75c96-cd6b-4fc7-9a51-1fa36470a614 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:45.157484 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-73e75c96-cd6b-4fc7-9a51-1fa36470a614 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:45.269298 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-eecb966b-bf59-4649-8f6f-d60a98bcc2e4 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:45.277146 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-eecb966b-bf59-4649-8f6f-d60a98bcc2e4 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/99a619a0-6d18-47e7-bbdf-811c2949405d" status: 200 len: 1367 microversion: 2.1 time: 0.156586 Jun 07 09:36:45.281479 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 432/867] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:36:45 2022] GET /compute/v2.1/servers/99a619a0-6d18-47e7-bbdf-811c2949405d => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:36:45.310942 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-73e75c96-cd6b-4fc7-9a51-1fa36470a614 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:45.318913 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-73e75c96-cd6b-4fc7-9a51-1fa36470a614 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:45.320407 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-73e75c96-cd6b-4fc7-9a51-1fa36470a614 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:45.321622 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-73e75c96-cd6b-4fc7-9a51-1fa36470a614 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31" status: 200 len: 1743 microversion: 2.20 time: 0.177187 Jun 07 09:36:45.322171 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 436/868] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:36:45 2022] GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31 => generated 1743 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 09:36:46.294429 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-dc2f6b98-e323-45cf-bd19-174bcb4dcc68 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:36:46.294953 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-dc2f6b98-e323-45cf-bd19-174bcb4dcc68 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 99a619a0-6d18-47e7-bbdf-811c2949405d] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:36:46.300988 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-dc2f6b98-e323-45cf-bd19-174bcb4dcc68 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:46.301439 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-dc2f6b98-e323-45cf-bd19-174bcb4dcc68 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:46.302200 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-dc2f6b98-e323-45cf-bd19-174bcb4dcc68 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:46.302637 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-dc2f6b98-e323-45cf-bd19-174bcb4dcc68 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:46.339192 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-366debc0-ba52-4e76-aca1-ec1ab71899b7 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:36:46.339804 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-366debc0-ba52-4e76-aca1-ec1ab71899b7 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 3cc1496a-defc-48eb-8e12-4b328dd6fa31] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:36:46.346335 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-366debc0-ba52-4e76-aca1-ec1ab71899b7 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:46.346788 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-366debc0-ba52-4e76-aca1-ec1ab71899b7 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:46.347559 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-366debc0-ba52-4e76-aca1-ec1ab71899b7 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:46.347997 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-366debc0-ba52-4e76-aca1-ec1ab71899b7 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:46.431923 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-dc2f6b98-e323-45cf-bd19-174bcb4dcc68 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:46.439803 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-dc2f6b98-e323-45cf-bd19-174bcb4dcc68 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/99a619a0-6d18-47e7-bbdf-811c2949405d" status: 200 len: 1367 microversion: 2.1 time: 0.149337 Jun 07 09:36:46.440362 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 433/869] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:36:46 2022] GET /compute/v2.1/servers/99a619a0-6d18-47e7-bbdf-811c2949405d => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:36:46.482155 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-366debc0-ba52-4e76-aca1-ec1ab71899b7 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:46.490113 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-366debc0-ba52-4e76-aca1-ec1ab71899b7 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:46.491610 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-366debc0-ba52-4e76-aca1-ec1ab71899b7 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:46.492837 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-366debc0-ba52-4e76-aca1-ec1ab71899b7 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31" status: 200 len: 1743 microversion: 2.20 time: 0.157545 Jun 07 09:36:46.493391 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 437/870] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:36:46 2022] GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31 => generated 1743 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 09:36:46.784608 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [req-98e0e44e-4d20-4471-b5fb-82bd0abbe4c4 req-a23a6d10-a2be-441e-8f5d-107210056f0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99a619a0-6d18-47e7-bbdf-811c2949405d", "name": "network-vif-plugged", "status": "completed", "tag": "de7081e5-144c-4179-9018-1cdedceee805"}]} {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:36:46.792463 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [req-98e0e44e-4d20-4471-b5fb-82bd0abbe4c4 req-a23a6d10-a2be-441e-8f5d-107210056f0a service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:46.792933 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [req-98e0e44e-4d20-4471-b5fb-82bd0abbe4c4 req-a23a6d10-a2be-441e-8f5d-107210056f0a service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:46.805820 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.compute.server_external_events [req-98e0e44e-4d20-4471-b5fb-82bd0abbe4c4 req-a23a6d10-a2be-441e-8f5d-107210056f0a service nova] Creating event network-vif-plugged:de7081e5-144c-4179-9018-1cdedceee805 for instance 99a619a0-6d18-47e7-bbdf-811c2949405d on hv-cinder-83699 Jun 07 09:36:46.808966 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [req-98e0e44e-4d20-4471-b5fb-82bd0abbe4c4 req-a23a6d10-a2be-441e-8f5d-107210056f0a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028075 Jun 07 09:36:46.809553 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 434/871] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Jun 7 09:36:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:36:47.383754 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-35ee4fb2-9159-43fc-8431-9116e46d9f06 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:36:47.384267 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-35ee4fb2-9159-43fc-8431-9116e46d9f06 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] [instance: dd2acb94-efe3-4c28-b597-21b0cfa1f27d] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:36:47.390755 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-35ee4fb2-9159-43fc-8431-9116e46d9f06 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:47.391768 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-35ee4fb2-9159-43fc-8431-9116e46d9f06 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:47.392531 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-35ee4fb2-9159-43fc-8431-9116e46d9f06 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:47.393027 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-35ee4fb2-9159-43fc-8431-9116e46d9f06 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:47.414709 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.objects.instance [None req-35ee4fb2-9159-43fc-8431-9116e46d9f06 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lazy-loading 'flavor' on Instance uuid dd2acb94-efe3-4c28-b597-21b0cfa1f27d {{(pid=118740) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 09:36:47.457066 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-1fcdc6a7-dc56-4501-882d-e617af8a836d tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:36:47.457755 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-1fcdc6a7-dc56-4501-882d-e617af8a836d tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 99a619a0-6d18-47e7-bbdf-811c2949405d] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:36:47.464160 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-1fcdc6a7-dc56-4501-882d-e617af8a836d tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:47.470375 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-1fcdc6a7-dc56-4501-882d-e617af8a836d tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:47.470375 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-1fcdc6a7-dc56-4501-882d-e617af8a836d tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:47.470375 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-1fcdc6a7-dc56-4501-882d-e617af8a836d tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:47.597293 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-1fcdc6a7-dc56-4501-882d-e617af8a836d tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:47.605291 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-1fcdc6a7-dc56-4501-882d-e617af8a836d tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/99a619a0-6d18-47e7-bbdf-811c2949405d" status: 200 len: 1367 microversion: 2.1 time: 0.152379 Jun 07 09:36:47.605867 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 435/872] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:36:47 2022] GET /compute/v2.1/servers/99a619a0-6d18-47e7-bbdf-811c2949405d => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:36:47.613549 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-f35a7ead-a38a-45b2-a50c-6e9467b00d61 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:36:47.614105 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-f35a7ead-a38a-45b2-a50c-6e9467b00d61 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 3cc1496a-defc-48eb-8e12-4b328dd6fa31] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:36:47.620032 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-f35a7ead-a38a-45b2-a50c-6e9467b00d61 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:47.620487 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-f35a7ead-a38a-45b2-a50c-6e9467b00d61 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:47.621284 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-f35a7ead-a38a-45b2-a50c-6e9467b00d61 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:47.621724 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-f35a7ead-a38a-45b2-a50c-6e9467b00d61 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:47.742306 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-35ee4fb2-9159-43fc-8431-9116e46d9f06 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] 10.222.0.57 "POST /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d/action" status: 202 len: 0 microversion: 2.1 time: 0.362144 Jun 07 09:36:47.743170 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 438/873] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Jun 7 09:36:47 2022] POST /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d/action => generated 0 bytes in 364 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 09:36:47.749372 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-62449118-5c69-4bf4-84a6-1c5ceaea2951 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "553371e8-3151-40aa-b198-0864b3eaf8d6"}} {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:36:47.751207 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-62449118-5c69-4bf4-84a6-1c5ceaea2951 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 51d3266a-292e-4fce-a594-e8cbda085c6e] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:36:47.754540 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-f35a7ead-a38a-45b2-a50c-6e9467b00d61 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:47.758031 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-62449118-5c69-4bf4-84a6-1c5ceaea2951 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:47.758561 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-62449118-5c69-4bf4-84a6-1c5ceaea2951 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:47.759421 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-62449118-5c69-4bf4-84a6-1c5ceaea2951 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:47.759936 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-62449118-5c69-4bf4-84a6-1c5ceaea2951 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:47.763762 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-f35a7ead-a38a-45b2-a50c-6e9467b00d61 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:47.765296 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-f35a7ead-a38a-45b2-a50c-6e9467b00d61 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:47.766502 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-f35a7ead-a38a-45b2-a50c-6e9467b00d61 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31" status: 200 len: 1743 microversion: 2.20 time: 0.157112 Jun 07 09:36:47.767076 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 436/874] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:36:47 2022] GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31 => generated 1743 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:36:47.771429 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-ac4c44fc-b5c3-4bd2-ae28-6fc406aeb4ab tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:36:47.772029 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-ac4c44fc-b5c3-4bd2-ae28-6fc406aeb4ab tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] [instance: dd2acb94-efe3-4c28-b597-21b0cfa1f27d] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:36:47.777885 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-ac4c44fc-b5c3-4bd2-ae28-6fc406aeb4ab tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:47.778322 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-ac4c44fc-b5c3-4bd2-ae28-6fc406aeb4ab tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:47.779238 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-ac4c44fc-b5c3-4bd2-ae28-6fc406aeb4ab tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:47.779669 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-ac4c44fc-b5c3-4bd2-ae28-6fc406aeb4ab tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:47.915754 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-ac4c44fc-b5c3-4bd2-ae28-6fc406aeb4ab tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db3cd25f4c94640854677709d10ccbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0e917f30d3430bb088ca3d0afe1a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:47.923995 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-ac4c44fc-b5c3-4bd2-ae28-6fc406aeb4ab tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] 10.222.0.57 "GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d" status: 200 len: 1568 microversion: 2.1 time: 0.155941 Jun 07 09:36:47.924488 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 437/875] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:36:47 2022] GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:36:48.625994 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-0216aba4-ebad-49fb-9c6d-550f990172bb tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:36:48.626662 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-0216aba4-ebad-49fb-9c6d-550f990172bb tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 99a619a0-6d18-47e7-bbdf-811c2949405d] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:36:48.633493 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-0216aba4-ebad-49fb-9c6d-550f990172bb tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:48.633943 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-0216aba4-ebad-49fb-9c6d-550f990172bb tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:48.634699 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-0216aba4-ebad-49fb-9c6d-550f990172bb tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:48.635133 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-0216aba4-ebad-49fb-9c6d-550f990172bb tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:48.761827 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-0216aba4-ebad-49fb-9c6d-550f990172bb tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:48.769220 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-0216aba4-ebad-49fb-9c6d-550f990172bb tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/99a619a0-6d18-47e7-bbdf-811c2949405d" status: 200 len: 1367 microversion: 2.1 time: 0.149264 Jun 07 09:36:48.769787 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 438/876] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:36:48 2022] GET /compute/v2.1/servers/99a619a0-6d18-47e7-bbdf-811c2949405d => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:36:48.787028 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-b5486355-5e31-409d-8e76-c1aaa60c4cba tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:36:48.787626 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-b5486355-5e31-409d-8e76-c1aaa60c4cba tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 3cc1496a-defc-48eb-8e12-4b328dd6fa31] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:36:48.793365 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b5486355-5e31-409d-8e76-c1aaa60c4cba tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:48.793817 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b5486355-5e31-409d-8e76-c1aaa60c4cba tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:48.794570 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b5486355-5e31-409d-8e76-c1aaa60c4cba tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:48.795004 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b5486355-5e31-409d-8e76-c1aaa60c4cba tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:48.925891 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-b5486355-5e31-409d-8e76-c1aaa60c4cba tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:48.933859 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-b5486355-5e31-409d-8e76-c1aaa60c4cba tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:48.935420 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-b5486355-5e31-409d-8e76-c1aaa60c4cba tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:48.937122 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-b5486355-5e31-409d-8e76-c1aaa60c4cba tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31" status: 200 len: 1743 microversion: 2.20 time: 0.153069 Jun 07 09:36:48.940731 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 439/877] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:36:48 2022] GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31 => generated 1743 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 09:36:48.945304 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-5001e733-275a-42e1-b3d4-1a20ad2f6419 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:36:48.945914 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-5001e733-275a-42e1-b3d4-1a20ad2f6419 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] [instance: dd2acb94-efe3-4c28-b597-21b0cfa1f27d] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:36:48.951846 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-5001e733-275a-42e1-b3d4-1a20ad2f6419 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:48.952289 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-5001e733-275a-42e1-b3d4-1a20ad2f6419 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:48.954576 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-5001e733-275a-42e1-b3d4-1a20ad2f6419 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:48.954576 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-5001e733-275a-42e1-b3d4-1a20ad2f6419 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:49.084067 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-5001e733-275a-42e1-b3d4-1a20ad2f6419 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db3cd25f4c94640854677709d10ccbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0e917f30d3430bb088ca3d0afe1a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:49.091615 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-5001e733-275a-42e1-b3d4-1a20ad2f6419 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] 10.222.0.57 "GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d" status: 200 len: 1568 microversion: 2.1 time: 0.149910 Jun 07 09:36:49.092178 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 440/878] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:36:48 2022] GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:36:49.785714 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-80c3e065-18b6-4677-a024-105e56dfe6fe tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:36:49.786359 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-80c3e065-18b6-4677-a024-105e56dfe6fe tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 99a619a0-6d18-47e7-bbdf-811c2949405d] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:36:49.792359 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-80c3e065-18b6-4677-a024-105e56dfe6fe tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:49.792834 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-80c3e065-18b6-4677-a024-105e56dfe6fe tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:49.793588 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-80c3e065-18b6-4677-a024-105e56dfe6fe tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:49.794013 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-80c3e065-18b6-4677-a024-105e56dfe6fe tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:49.798655 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writing DB stats nova_cell1:SELECT=100 {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:36:49.926750 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-80c3e065-18b6-4677-a024-105e56dfe6fe tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:49.934585 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-80c3e065-18b6-4677-a024-105e56dfe6fe tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/99a619a0-6d18-47e7-bbdf-811c2949405d" status: 200 len: 1556 microversion: 2.1 time: 0.152516 Jun 07 09:36:49.935204 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 441/879] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:36:49 2022] GET /compute/v2.1/servers/99a619a0-6d18-47e7-bbdf-811c2949405d => generated 1556 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:36:49.951754 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-91086fc1-1ea6-42d3-a312-7d1845ac2da0 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:36:49.952221 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-91086fc1-1ea6-42d3-a312-7d1845ac2da0 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 99a619a0-6d18-47e7-bbdf-811c2949405d] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:36:49.958231 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-91086fc1-1ea6-42d3-a312-7d1845ac2da0 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:49.958673 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-91086fc1-1ea6-42d3-a312-7d1845ac2da0 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:49.959425 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-91086fc1-1ea6-42d3-a312-7d1845ac2da0 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:49.959854 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-91086fc1-1ea6-42d3-a312-7d1845ac2da0 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:50.044860 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-91086fc1-1ea6-42d3-a312-7d1845ac2da0 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/99a619a0-6d18-47e7-bbdf-811c2949405d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096810 Jun 07 09:36:50.045445 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 442/880] 10.222.0.57 () {58 vars in 1274 bytes} [Tue Jun 7 09:36:49 2022] GET /compute/v2.1/servers/99a619a0-6d18-47e7-bbdf-811c2949405d/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 09:36:50.050651 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-294287a1-661d-4490-af0d-eb125b0c2543 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:36:50.054466 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-294287a1-661d-4490-af0d-eb125b0c2543 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 3cc1496a-defc-48eb-8e12-4b328dd6fa31] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:36:50.057437 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-294287a1-661d-4490-af0d-eb125b0c2543 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:50.057893 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-294287a1-661d-4490-af0d-eb125b0c2543 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:50.058632 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-294287a1-661d-4490-af0d-eb125b0c2543 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:50.059255 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-294287a1-661d-4490-af0d-eb125b0c2543 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:50.323381 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-294287a1-661d-4490-af0d-eb125b0c2543 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:50.329754 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-294287a1-661d-4490-af0d-eb125b0c2543 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:50.331280 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-294287a1-661d-4490-af0d-eb125b0c2543 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:50.332451 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-294287a1-661d-4490-af0d-eb125b0c2543 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31" status: 200 len: 1738 microversion: 2.20 time: 0.286101 Jun 07 09:36:50.333041 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 443/881] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:36:50 2022] GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31 => generated 1738 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:36:50.337476 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-111daba6-0ab7-47f0-9f4c-6981c0c06cf4 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:36:50.338074 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-111daba6-0ab7-47f0-9f4c-6981c0c06cf4 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] [instance: dd2acb94-efe3-4c28-b597-21b0cfa1f27d] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:36:50.344515 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-111daba6-0ab7-47f0-9f4c-6981c0c06cf4 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:50.346712 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-111daba6-0ab7-47f0-9f4c-6981c0c06cf4 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:50.346995 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-111daba6-0ab7-47f0-9f4c-6981c0c06cf4 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:50.347444 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-111daba6-0ab7-47f0-9f4c-6981c0c06cf4 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:50.398234 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-62449118-5c69-4bf4-84a6-1c5ceaea2951 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "POST /compute/v2.1/servers/51d3266a-292e-4fce-a594-e8cbda085c6e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.653697 Jun 07 09:36:50.399105 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 439/882] 10.222.0.57 () {60 vars in 1322 bytes} [Tue Jun 7 09:36:47 2022] POST /compute/v2.1/servers/51d3266a-292e-4fce-a594-e8cbda085c6e/os-volume_attachments => generated 194 bytes in 2655 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:36:50.597523 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-111daba6-0ab7-47f0-9f4c-6981c0c06cf4 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db3cd25f4c94640854677709d10ccbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0e917f30d3430bb088ca3d0afe1a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:50.612727 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-111daba6-0ab7-47f0-9f4c-6981c0c06cf4 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] 10.222.0.57 "GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d" status: 200 len: 1568 microversion: 2.1 time: 0.278201 Jun 07 09:36:50.624434 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 444/883] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:36:50 2022] GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d => generated 1568 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:36:51.249630 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [req-6beb5cdb-a992-4358-aa3e-e42e110dbc8c req-e47ecc91-7edb-4217-bba2-505595e98520 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99a619a0-6d18-47e7-bbdf-811c2949405d", "tag": "de7081e5-144c-4179-9018-1cdedceee805"}]} {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:36:51.260805 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [req-6beb5cdb-a992-4358-aa3e-e42e110dbc8c req-e47ecc91-7edb-4217-bba2-505595e98520 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:51.261693 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [req-6beb5cdb-a992-4358-aa3e-e42e110dbc8c req-e47ecc91-7edb-4217-bba2-505595e98520 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:51.273853 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.compute.server_external_events [req-6beb5cdb-a992-4358-aa3e-e42e110dbc8c req-e47ecc91-7edb-4217-bba2-505595e98520 service nova] Creating event network-changed:de7081e5-144c-4179-9018-1cdedceee805 for instance 99a619a0-6d18-47e7-bbdf-811c2949405d on hv-cinder-83699 Jun 07 09:36:51.279144 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [req-6beb5cdb-a992-4358-aa3e-e42e110dbc8c req-e47ecc91-7edb-4217-bba2-505595e98520 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035662 Jun 07 09:36:51.280373 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 440/884] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Jun 7 09:36:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 09:36:51.353707 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-866820c5-f27b-45dc-a376-d02f1f5aedb4 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:36:51.355043 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-866820c5-f27b-45dc-a376-d02f1f5aedb4 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 3cc1496a-defc-48eb-8e12-4b328dd6fa31] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:36:51.363058 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-866820c5-f27b-45dc-a376-d02f1f5aedb4 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:51.363870 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-866820c5-f27b-45dc-a376-d02f1f5aedb4 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:51.364920 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-866820c5-f27b-45dc-a376-d02f1f5aedb4 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:51.365630 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-866820c5-f27b-45dc-a376-d02f1f5aedb4 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:51.633145 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-eddedc3b-ad73-48a6-9ee2-a875d4cb5a07 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:36:51.634508 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-eddedc3b-ad73-48a6-9ee2-a875d4cb5a07 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] [instance: dd2acb94-efe3-4c28-b597-21b0cfa1f27d] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:36:51.640912 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-866820c5-f27b-45dc-a376-d02f1f5aedb4 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:51.654451 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-866820c5-f27b-45dc-a376-d02f1f5aedb4 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:51.654831 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-eddedc3b-ad73-48a6-9ee2-a875d4cb5a07 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:51.655491 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-eddedc3b-ad73-48a6-9ee2-a875d4cb5a07 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:51.657108 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-eddedc3b-ad73-48a6-9ee2-a875d4cb5a07 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:51.657866 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-866820c5-f27b-45dc-a376-d02f1f5aedb4 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:51.659703 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-eddedc3b-ad73-48a6-9ee2-a875d4cb5a07 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:51.663915 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-866820c5-f27b-45dc-a376-d02f1f5aedb4 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31" status: 200 len: 1738 microversion: 2.20 time: 0.309899 Jun 07 09:36:51.665148 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 445/885] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:36:51 2022] GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31 => generated 1738 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:36:51.898643 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-eddedc3b-ad73-48a6-9ee2-a875d4cb5a07 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db3cd25f4c94640854677709d10ccbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0e917f30d3430bb088ca3d0afe1a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:51.907648 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-eddedc3b-ad73-48a6-9ee2-a875d4cb5a07 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] 10.222.0.57 "GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d" status: 200 len: 1568 microversion: 2.1 time: 0.279489 Jun 07 09:36:51.918713 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 441/886] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:36:51 2022] GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d => generated 1568 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:36:52.685169 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-1d4bf88c-e666-4ad6-8008-c2a3605080d5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:36:52.686457 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-1d4bf88c-e666-4ad6-8008-c2a3605080d5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 3cc1496a-defc-48eb-8e12-4b328dd6fa31] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:36:52.689294 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:36:52.694222 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-1d4bf88c-e666-4ad6-8008-c2a3605080d5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:52.695003 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-1d4bf88c-e666-4ad6-8008-c2a3605080d5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:52.695985 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-1d4bf88c-e666-4ad6-8008-c2a3605080d5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:52.696601 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-1d4bf88c-e666-4ad6-8008-c2a3605080d5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:52.864644 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-1d4bf88c-e666-4ad6-8008-c2a3605080d5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:52.878058 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-1d4bf88c-e666-4ad6-8008-c2a3605080d5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:52.880927 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-1d4bf88c-e666-4ad6-8008-c2a3605080d5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:52.882422 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-1d4bf88c-e666-4ad6-8008-c2a3605080d5 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31" status: 200 len: 1738 microversion: 2.20 time: 0.203769 Jun 07 09:36:52.883076 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 446/887] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:36:52 2022] GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31 => generated 1738 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:36:52.925263 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-6dbcd384-4321-4618-aa39-8857ac5bd098 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:36:52.926634 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-6dbcd384-4321-4618-aa39-8857ac5bd098 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] [instance: dd2acb94-efe3-4c28-b597-21b0cfa1f27d] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:36:52.934993 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-6dbcd384-4321-4618-aa39-8857ac5bd098 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:52.935496 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-6dbcd384-4321-4618-aa39-8857ac5bd098 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:52.936733 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-6dbcd384-4321-4618-aa39-8857ac5bd098 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:52.937324 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-6dbcd384-4321-4618-aa39-8857ac5bd098 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:53.120834 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-6dbcd384-4321-4618-aa39-8857ac5bd098 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db3cd25f4c94640854677709d10ccbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0e917f30d3430bb088ca3d0afe1a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:53.129883 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-6dbcd384-4321-4618-aa39-8857ac5bd098 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] 10.222.0.57 "GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d" status: 200 len: 1568 microversion: 2.1 time: 0.208963 Jun 07 09:36:53.130825 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 442/888] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:36:52 2022] GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d => generated 1568 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:36:53.901316 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-df215466-51b8-4140-b046-f2da58da4b69 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:36:53.901836 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-df215466-51b8-4140-b046-f2da58da4b69 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 3cc1496a-defc-48eb-8e12-4b328dd6fa31] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:36:53.908787 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-df215466-51b8-4140-b046-f2da58da4b69 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:53.909234 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-df215466-51b8-4140-b046-f2da58da4b69 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:53.909993 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-df215466-51b8-4140-b046-f2da58da4b69 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:53.910426 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-df215466-51b8-4140-b046-f2da58da4b69 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:54.040126 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-df215466-51b8-4140-b046-f2da58da4b69 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:54.049182 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-df215466-51b8-4140-b046-f2da58da4b69 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:54.050540 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-df215466-51b8-4140-b046-f2da58da4b69 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:54.051753 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-df215466-51b8-4140-b046-f2da58da4b69 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31" status: 200 len: 1738 microversion: 2.20 time: 0.154493 Jun 07 09:36:54.052465 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 447/889] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:36:53 2022] GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31 => generated 1738 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:36:54.147717 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-bbd123c8-4781-458c-b3be-892c8899490e tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:36:54.148368 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-bbd123c8-4781-458c-b3be-892c8899490e tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] [instance: dd2acb94-efe3-4c28-b597-21b0cfa1f27d] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:36:54.154879 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-bbd123c8-4781-458c-b3be-892c8899490e tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:54.155556 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-bbd123c8-4781-458c-b3be-892c8899490e tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:54.156344 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-bbd123c8-4781-458c-b3be-892c8899490e tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:54.156812 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-bbd123c8-4781-458c-b3be-892c8899490e tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:54.301381 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-bbd123c8-4781-458c-b3be-892c8899490e tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db3cd25f4c94640854677709d10ccbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0e917f30d3430bb088ca3d0afe1a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:54.309796 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-bbd123c8-4781-458c-b3be-892c8899490e tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] 10.222.0.57 "GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d" status: 200 len: 1568 microversion: 2.1 time: 0.166030 Jun 07 09:36:54.310893 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 443/890] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:36:54 2022] GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:36:55.071090 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-cf85cfc9-ac18-4bd1-bd02-d6047d490007 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:36:55.071929 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-cf85cfc9-ac18-4bd1-bd02-d6047d490007 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 3cc1496a-defc-48eb-8e12-4b328dd6fa31] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:36:55.078325 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-cf85cfc9-ac18-4bd1-bd02-d6047d490007 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:55.080610 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-cf85cfc9-ac18-4bd1-bd02-d6047d490007 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:55.080610 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-cf85cfc9-ac18-4bd1-bd02-d6047d490007 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:55.081168 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-cf85cfc9-ac18-4bd1-bd02-d6047d490007 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:55.231065 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-cf85cfc9-ac18-4bd1-bd02-d6047d490007 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:55.239787 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-cf85cfc9-ac18-4bd1-bd02-d6047d490007 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:55.241576 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-cf85cfc9-ac18-4bd1-bd02-d6047d490007 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:55.243259 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-cf85cfc9-ac18-4bd1-bd02-d6047d490007 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31" status: 200 len: 1738 microversion: 2.20 time: 0.175893 Jun 07 09:36:55.243643 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 448/891] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:36:55 2022] GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31 => generated 1738 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 09:36:55.327168 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-80a6623d-c4d0-4872-a741-9f6372fa81c8 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:36:55.328471 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-80a6623d-c4d0-4872-a741-9f6372fa81c8 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] [instance: dd2acb94-efe3-4c28-b597-21b0cfa1f27d] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:36:55.336273 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-80a6623d-c4d0-4872-a741-9f6372fa81c8 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:55.336994 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-80a6623d-c4d0-4872-a741-9f6372fa81c8 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:55.338020 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-80a6623d-c4d0-4872-a741-9f6372fa81c8 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:55.338556 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-80a6623d-c4d0-4872-a741-9f6372fa81c8 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:55.358164 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:36:55.479597 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-80a6623d-c4d0-4872-a741-9f6372fa81c8 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db3cd25f4c94640854677709d10ccbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0e917f30d3430bb088ca3d0afe1a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:55.487838 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-80a6623d-c4d0-4872-a741-9f6372fa81c8 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] 10.222.0.57 "GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d" status: 200 len: 1568 microversion: 2.1 time: 0.164492 Jun 07 09:36:55.488413 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 444/892] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:36:55 2022] GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:36:56.262180 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-38aed139-5364-47db-8ba2-9eb9f6588182 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:36:56.262738 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-38aed139-5364-47db-8ba2-9eb9f6588182 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 3cc1496a-defc-48eb-8e12-4b328dd6fa31] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:36:56.269000 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-38aed139-5364-47db-8ba2-9eb9f6588182 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:56.269436 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-38aed139-5364-47db-8ba2-9eb9f6588182 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:56.270197 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-38aed139-5364-47db-8ba2-9eb9f6588182 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:56.270631 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-38aed139-5364-47db-8ba2-9eb9f6588182 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:56.417382 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-38aed139-5364-47db-8ba2-9eb9f6588182 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:56.433408 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-38aed139-5364-47db-8ba2-9eb9f6588182 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:56.434954 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-38aed139-5364-47db-8ba2-9eb9f6588182 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:56.436404 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-38aed139-5364-47db-8ba2-9eb9f6588182 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31" status: 200 len: 1738 microversion: 2.20 time: 0.178187 Jun 07 09:36:56.447297 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 449/893] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:36:56 2022] GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31 => generated 1738 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 09:36:56.506407 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-116828a9-8343-48fb-8705-3dc7b7a617ff tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:36:56.507677 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-116828a9-8343-48fb-8705-3dc7b7a617ff tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] [instance: dd2acb94-efe3-4c28-b597-21b0cfa1f27d] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:36:56.515886 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-116828a9-8343-48fb-8705-3dc7b7a617ff tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:56.516543 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-116828a9-8343-48fb-8705-3dc7b7a617ff tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:56.518051 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-116828a9-8343-48fb-8705-3dc7b7a617ff tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:56.518659 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-116828a9-8343-48fb-8705-3dc7b7a617ff tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:56.924111 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-116828a9-8343-48fb-8705-3dc7b7a617ff tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db3cd25f4c94640854677709d10ccbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0e917f30d3430bb088ca3d0afe1a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:56.931957 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-116828a9-8343-48fb-8705-3dc7b7a617ff tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] 10.222.0.57 "GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d" status: 200 len: 1568 microversion: 2.1 time: 0.430237 Jun 07 09:36:56.932637 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 445/894] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:36:56 2022] GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d => generated 1568 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:36:57.455172 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-e33c99d6-5c2a-43ad-85e1-069ab63a06a6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:36:57.455917 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-e33c99d6-5c2a-43ad-85e1-069ab63a06a6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 3cc1496a-defc-48eb-8e12-4b328dd6fa31] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:36:57.462160 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-e33c99d6-5c2a-43ad-85e1-069ab63a06a6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:57.462623 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-e33c99d6-5c2a-43ad-85e1-069ab63a06a6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:57.463376 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-e33c99d6-5c2a-43ad-85e1-069ab63a06a6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:57.463811 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-e33c99d6-5c2a-43ad-85e1-069ab63a06a6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:57.598776 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-e33c99d6-5c2a-43ad-85e1-069ab63a06a6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:57.608004 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-e33c99d6-5c2a-43ad-85e1-069ab63a06a6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:57.610220 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-e33c99d6-5c2a-43ad-85e1-069ab63a06a6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:57.611355 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-e33c99d6-5c2a-43ad-85e1-069ab63a06a6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31" status: 200 len: 1738 microversion: 2.20 time: 0.160704 Jun 07 09:36:57.611904 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 450/895] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:36:57 2022] GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31 => generated 1738 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:36:57.953247 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-954ed05e-195b-4154-aba4-133b5ddb2e87 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:36:57.953860 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-954ed05e-195b-4154-aba4-133b5ddb2e87 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] [instance: dd2acb94-efe3-4c28-b597-21b0cfa1f27d] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:36:57.960690 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-954ed05e-195b-4154-aba4-133b5ddb2e87 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:57.961350 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-954ed05e-195b-4154-aba4-133b5ddb2e87 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:57.962324 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-954ed05e-195b-4154-aba4-133b5ddb2e87 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:57.962980 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-954ed05e-195b-4154-aba4-133b5ddb2e87 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:58.124042 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-954ed05e-195b-4154-aba4-133b5ddb2e87 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db3cd25f4c94640854677709d10ccbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0e917f30d3430bb088ca3d0afe1a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:58.132076 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-954ed05e-195b-4154-aba4-133b5ddb2e87 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] 10.222.0.57 "GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d" status: 200 len: 1568 microversion: 2.1 time: 0.185330 Jun 07 09:36:58.132993 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 446/896] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:36:57 2022] GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d => generated 1568 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:36:58.629246 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-434ab192-fabe-42e6-a7bb-cb5508d42682 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:36:58.630594 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-434ab192-fabe-42e6-a7bb-cb5508d42682 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 3cc1496a-defc-48eb-8e12-4b328dd6fa31] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:36:58.637672 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-434ab192-fabe-42e6-a7bb-cb5508d42682 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:58.638405 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-434ab192-fabe-42e6-a7bb-cb5508d42682 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:58.639428 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-434ab192-fabe-42e6-a7bb-cb5508d42682 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:58.639931 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-434ab192-fabe-42e6-a7bb-cb5508d42682 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:58.780946 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-434ab192-fabe-42e6-a7bb-cb5508d42682 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:58.797528 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-434ab192-fabe-42e6-a7bb-cb5508d42682 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:58.799728 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-434ab192-fabe-42e6-a7bb-cb5508d42682 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:58.801199 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-434ab192-fabe-42e6-a7bb-cb5508d42682 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31" status: 200 len: 1738 microversion: 2.20 time: 0.176393 Jun 07 09:36:58.809775 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 451/897] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:36:58 2022] GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31 => generated 1738 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:36:59.149584 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-dc41472c-3542-4bd6-a8ed-7704b036e08a tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:36:59.151000 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-dc41472c-3542-4bd6-a8ed-7704b036e08a tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] [instance: dd2acb94-efe3-4c28-b597-21b0cfa1f27d] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:36:59.160167 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-dc41472c-3542-4bd6-a8ed-7704b036e08a tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:59.161052 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-dc41472c-3542-4bd6-a8ed-7704b036e08a tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:59.167040 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-dc41472c-3542-4bd6-a8ed-7704b036e08a tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:59.167040 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-dc41472c-3542-4bd6-a8ed-7704b036e08a tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:59.316766 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-dc41472c-3542-4bd6-a8ed-7704b036e08a tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db3cd25f4c94640854677709d10ccbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0e917f30d3430bb088ca3d0afe1a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:59.324883 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-dc41472c-3542-4bd6-a8ed-7704b036e08a tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] 10.222.0.57 "GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d" status: 200 len: 1568 microversion: 2.1 time: 0.179414 Jun 07 09:36:59.325788 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 447/898] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:36:59 2022] GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d => generated 1568 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:36:59.819372 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-44cdb56a-f30f-4144-838b-5a4749ff1615 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:36:59.820926 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-44cdb56a-f30f-4144-838b-5a4749ff1615 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 3cc1496a-defc-48eb-8e12-4b328dd6fa31] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:36:59.827630 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-44cdb56a-f30f-4144-838b-5a4749ff1615 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:59.828342 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-44cdb56a-f30f-4144-838b-5a4749ff1615 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:59.829559 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-44cdb56a-f30f-4144-838b-5a4749ff1615 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:36:59.830548 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-44cdb56a-f30f-4144-838b-5a4749ff1615 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:36:59.974950 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-44cdb56a-f30f-4144-838b-5a4749ff1615 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:59.983723 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-44cdb56a-f30f-4144-838b-5a4749ff1615 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:59.985283 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-44cdb56a-f30f-4144-838b-5a4749ff1615 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:36:59.987201 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-44cdb56a-f30f-4144-838b-5a4749ff1615 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31" status: 200 len: 1738 microversion: 2.20 time: 0.171547 Jun 07 09:36:59.987946 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 452/899] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:36:59 2022] GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31 => generated 1738 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:37:00.345565 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-146c30d0-a86f-478d-9483-725089114023 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:00.346168 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-146c30d0-a86f-478d-9483-725089114023 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] [instance: dd2acb94-efe3-4c28-b597-21b0cfa1f27d] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:00.355296 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-146c30d0-a86f-478d-9483-725089114023 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:00.355999 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-146c30d0-a86f-478d-9483-725089114023 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:00.357138 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-146c30d0-a86f-478d-9483-725089114023 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:00.357777 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-146c30d0-a86f-478d-9483-725089114023 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:00.507453 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-146c30d0-a86f-478d-9483-725089114023 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db3cd25f4c94640854677709d10ccbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0e917f30d3430bb088ca3d0afe1a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:00.520180 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-146c30d0-a86f-478d-9483-725089114023 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] 10.222.0.57 "GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d" status: 200 len: 1568 microversion: 2.1 time: 0.178984 Jun 07 09:37:00.521118 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 448/900] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:37:00 2022] GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d => generated 1568 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:37:01.006086 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-df71b271-6b1e-4e89-9f94-5f37f78c1494 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:01.007225 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-df71b271-6b1e-4e89-9f94-5f37f78c1494 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 3cc1496a-defc-48eb-8e12-4b328dd6fa31] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:01.012798 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-df71b271-6b1e-4e89-9f94-5f37f78c1494 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:01.013252 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-df71b271-6b1e-4e89-9f94-5f37f78c1494 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:01.014076 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-df71b271-6b1e-4e89-9f94-5f37f78c1494 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:01.014565 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-df71b271-6b1e-4e89-9f94-5f37f78c1494 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:01.160048 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-df71b271-6b1e-4e89-9f94-5f37f78c1494 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:01.168007 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-df71b271-6b1e-4e89-9f94-5f37f78c1494 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:01.175999 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-df71b271-6b1e-4e89-9f94-5f37f78c1494 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:01.175999 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-df71b271-6b1e-4e89-9f94-5f37f78c1494 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31" status: 200 len: 1738 microversion: 2.20 time: 0.168380 Jun 07 09:37:01.175999 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 453/901] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:37:01 2022] GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31 => generated 1738 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:37:01.541730 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-bc596c36-7fb4-401b-ad8d-d261d4721eb7 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:01.543143 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-bc596c36-7fb4-401b-ad8d-d261d4721eb7 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] [instance: dd2acb94-efe3-4c28-b597-21b0cfa1f27d] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:01.549680 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-bc596c36-7fb4-401b-ad8d-d261d4721eb7 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:01.550358 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-bc596c36-7fb4-401b-ad8d-d261d4721eb7 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:01.551162 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-bc596c36-7fb4-401b-ad8d-d261d4721eb7 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:01.552045 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-bc596c36-7fb4-401b-ad8d-d261d4721eb7 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:01.705473 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-bc596c36-7fb4-401b-ad8d-d261d4721eb7 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db3cd25f4c94640854677709d10ccbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0e917f30d3430bb088ca3d0afe1a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:01.714373 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-bc596c36-7fb4-401b-ad8d-d261d4721eb7 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] 10.222.0.57 "GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d" status: 200 len: 1568 microversion: 2.1 time: 0.176750 Jun 07 09:37:01.725680 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 449/902] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:37:01 2022] GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d => generated 1568 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:37:02.190834 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-952edc0b-e668-43ac-abd7-290f02b0e0ec tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:02.191442 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-952edc0b-e668-43ac-abd7-290f02b0e0ec tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 3cc1496a-defc-48eb-8e12-4b328dd6fa31] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:02.197586 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-952edc0b-e668-43ac-abd7-290f02b0e0ec tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:02.201852 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-952edc0b-e668-43ac-abd7-290f02b0e0ec tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:02.201852 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-952edc0b-e668-43ac-abd7-290f02b0e0ec tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:02.201852 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-952edc0b-e668-43ac-abd7-290f02b0e0ec tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:02.333775 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-952edc0b-e668-43ac-abd7-290f02b0e0ec tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:02.341793 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-952edc0b-e668-43ac-abd7-290f02b0e0ec tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:02.343480 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-952edc0b-e668-43ac-abd7-290f02b0e0ec tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:02.344645 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-952edc0b-e668-43ac-abd7-290f02b0e0ec tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31" status: 200 len: 1738 microversion: 2.20 time: 0.157784 Jun 07 09:37:02.345822 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 454/903] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:37:02 2022] GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31 => generated 1738 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:37:02.732512 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-02080184-b224-4ff1-a54c-36c253c6cb54 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:02.733254 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-02080184-b224-4ff1-a54c-36c253c6cb54 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] [instance: dd2acb94-efe3-4c28-b597-21b0cfa1f27d] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:02.740343 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-02080184-b224-4ff1-a54c-36c253c6cb54 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:02.740820 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-02080184-b224-4ff1-a54c-36c253c6cb54 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:02.741578 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-02080184-b224-4ff1-a54c-36c253c6cb54 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:02.742013 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-02080184-b224-4ff1-a54c-36c253c6cb54 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:02.871204 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-02080184-b224-4ff1-a54c-36c253c6cb54 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db3cd25f4c94640854677709d10ccbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0e917f30d3430bb088ca3d0afe1a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:02.879388 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-02080184-b224-4ff1-a54c-36c253c6cb54 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] 10.222.0.57 "GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d" status: 200 len: 1568 microversion: 2.1 time: 0.150630 Jun 07 09:37:02.880035 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 450/904] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:37:02 2022] GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:37:03.363993 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-cbdcd6a6-b1fb-48a7-a796-382ca9ed892f tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:03.364533 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-cbdcd6a6-b1fb-48a7-a796-382ca9ed892f tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 3cc1496a-defc-48eb-8e12-4b328dd6fa31] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:03.370419 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-cbdcd6a6-b1fb-48a7-a796-382ca9ed892f tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:03.370861 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-cbdcd6a6-b1fb-48a7-a796-382ca9ed892f tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:03.371606 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-cbdcd6a6-b1fb-48a7-a796-382ca9ed892f tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:03.372032 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-cbdcd6a6-b1fb-48a7-a796-382ca9ed892f tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:03.499407 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-cbdcd6a6-b1fb-48a7-a796-382ca9ed892f tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:03.507704 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-cbdcd6a6-b1fb-48a7-a796-382ca9ed892f tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:03.509218 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-cbdcd6a6-b1fb-48a7-a796-382ca9ed892f tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:03.510345 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-cbdcd6a6-b1fb-48a7-a796-382ca9ed892f tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31" status: 200 len: 1738 microversion: 2.20 time: 0.150476 Jun 07 09:37:03.510897 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 455/905] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:37:03 2022] GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31 => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:37:03.896014 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-c8d791cf-ccc0-46d0-a4aa-3fa1cb12c558 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:03.896656 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-c8d791cf-ccc0-46d0-a4aa-3fa1cb12c558 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] [instance: dd2acb94-efe3-4c28-b597-21b0cfa1f27d] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:03.903207 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-c8d791cf-ccc0-46d0-a4aa-3fa1cb12c558 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:03.903659 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-c8d791cf-ccc0-46d0-a4aa-3fa1cb12c558 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:03.904425 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-c8d791cf-ccc0-46d0-a4aa-3fa1cb12c558 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:03.904895 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-c8d791cf-ccc0-46d0-a4aa-3fa1cb12c558 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:04.036769 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-c8d791cf-ccc0-46d0-a4aa-3fa1cb12c558 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db3cd25f4c94640854677709d10ccbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0e917f30d3430bb088ca3d0afe1a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:04.043376 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-c8d791cf-ccc0-46d0-a4aa-3fa1cb12c558 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] 10.222.0.57 "GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d" status: 200 len: 1568 microversion: 2.1 time: 0.151222 Jun 07 09:37:04.044443 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 451/906] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:37:03 2022] GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:37:04.528924 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-ffc6bcad-c4aa-4f26-9a0f-d71acf616e11 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:04.529625 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-ffc6bcad-c4aa-4f26-9a0f-d71acf616e11 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 3cc1496a-defc-48eb-8e12-4b328dd6fa31] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:04.535972 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-ffc6bcad-c4aa-4f26-9a0f-d71acf616e11 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:04.536410 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-ffc6bcad-c4aa-4f26-9a0f-d71acf616e11 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:04.537183 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-ffc6bcad-c4aa-4f26-9a0f-d71acf616e11 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:04.537612 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-ffc6bcad-c4aa-4f26-9a0f-d71acf616e11 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:04.667620 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-ffc6bcad-c4aa-4f26-9a0f-d71acf616e11 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:04.675510 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-ffc6bcad-c4aa-4f26-9a0f-d71acf616e11 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:04.677019 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-ffc6bcad-c4aa-4f26-9a0f-d71acf616e11 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:04.678183 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-ffc6bcad-c4aa-4f26-9a0f-d71acf616e11 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31" status: 200 len: 1738 microversion: 2.20 time: 0.153096 Jun 07 09:37:04.678729 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 456/907] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:37:04 2022] GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31 => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:37:05.062166 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-bc8f1544-3f5c-4a8c-8a29-b7d814f4d4fe tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:05.062823 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-bc8f1544-3f5c-4a8c-8a29-b7d814f4d4fe tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] [instance: dd2acb94-efe3-4c28-b597-21b0cfa1f27d] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:05.070926 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-bc8f1544-3f5c-4a8c-8a29-b7d814f4d4fe tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:05.071627 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-bc8f1544-3f5c-4a8c-8a29-b7d814f4d4fe tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:05.072804 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-bc8f1544-3f5c-4a8c-8a29-b7d814f4d4fe tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:05.073387 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-bc8f1544-3f5c-4a8c-8a29-b7d814f4d4fe tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:05.217576 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-bc8f1544-3f5c-4a8c-8a29-b7d814f4d4fe tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db3cd25f4c94640854677709d10ccbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0e917f30d3430bb088ca3d0afe1a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:05.225685 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-bc8f1544-3f5c-4a8c-8a29-b7d814f4d4fe tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] 10.222.0.57 "GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d" status: 200 len: 1568 microversion: 2.1 time: 0.167727 Jun 07 09:37:05.226303 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 452/908] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:37:05 2022] GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:37:05.695850 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-2c145716-3fa7-4978-8955-7969c282523b tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:05.696462 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-2c145716-3fa7-4978-8955-7969c282523b tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 3cc1496a-defc-48eb-8e12-4b328dd6fa31] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:05.702716 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-2c145716-3fa7-4978-8955-7969c282523b tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:05.703166 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-2c145716-3fa7-4978-8955-7969c282523b tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:05.703929 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-2c145716-3fa7-4978-8955-7969c282523b tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:05.704471 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-2c145716-3fa7-4978-8955-7969c282523b tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:05.831692 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-2c145716-3fa7-4978-8955-7969c282523b tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:05.839889 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-2c145716-3fa7-4978-8955-7969c282523b tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:05.841431 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-2c145716-3fa7-4978-8955-7969c282523b tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:05.842684 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-2c145716-3fa7-4978-8955-7969c282523b tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31" status: 200 len: 1738 microversion: 2.20 time: 0.150866 Jun 07 09:37:05.843241 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 457/909] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:37:05 2022] GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31 => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:37:06.243887 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-673f1823-aa98-4a90-89de-bea739d9ff59 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:06.244499 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-673f1823-aa98-4a90-89de-bea739d9ff59 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] [instance: dd2acb94-efe3-4c28-b597-21b0cfa1f27d] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:06.250937 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-673f1823-aa98-4a90-89de-bea739d9ff59 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:06.251398 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-673f1823-aa98-4a90-89de-bea739d9ff59 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:06.252173 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-673f1823-aa98-4a90-89de-bea739d9ff59 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:06.252710 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-673f1823-aa98-4a90-89de-bea739d9ff59 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:06.387541 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-673f1823-aa98-4a90-89de-bea739d9ff59 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db3cd25f4c94640854677709d10ccbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0e917f30d3430bb088ca3d0afe1a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:06.395610 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-673f1823-aa98-4a90-89de-bea739d9ff59 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] 10.222.0.57 "GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d" status: 200 len: 1568 microversion: 2.1 time: 0.155702 Jun 07 09:37:06.396174 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 453/910] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:37:06 2022] GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:37:06.861307 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-bc0ca4ba-dd0d-4149-8319-d071918f0503 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:06.861819 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-bc0ca4ba-dd0d-4149-8319-d071918f0503 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 3cc1496a-defc-48eb-8e12-4b328dd6fa31] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:06.867790 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-bc0ca4ba-dd0d-4149-8319-d071918f0503 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:06.868235 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-bc0ca4ba-dd0d-4149-8319-d071918f0503 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:06.869026 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-bc0ca4ba-dd0d-4149-8319-d071918f0503 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:06.869460 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-bc0ca4ba-dd0d-4149-8319-d071918f0503 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:06.873445 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writing DB stats nova_cell1:SELECT=100 {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:37:07.000044 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-bc0ca4ba-dd0d-4149-8319-d071918f0503 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:07.008903 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-bc0ca4ba-dd0d-4149-8319-d071918f0503 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:07.010412 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-bc0ca4ba-dd0d-4149-8319-d071918f0503 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:07.011567 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-bc0ca4ba-dd0d-4149-8319-d071918f0503 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31" status: 200 len: 1720 microversion: 2.20 time: 0.154311 Jun 07 09:37:07.012130 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 458/911] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:37:06 2022] GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31 => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:37:07.414557 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-ecca9084-7e9d-48a9-86bb-61ecc24793c7 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:07.415724 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-ecca9084-7e9d-48a9-86bb-61ecc24793c7 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] [instance: dd2acb94-efe3-4c28-b597-21b0cfa1f27d] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:07.423643 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-ecca9084-7e9d-48a9-86bb-61ecc24793c7 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:07.424375 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-ecca9084-7e9d-48a9-86bb-61ecc24793c7 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:07.425601 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-ecca9084-7e9d-48a9-86bb-61ecc24793c7 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:07.426356 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-ecca9084-7e9d-48a9-86bb-61ecc24793c7 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:07.557502 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-4d0a0047-9a5e-480e-b0ea-cfd206fe5f98 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:07.558863 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-4d0a0047-9a5e-480e-b0ea-cfd206fe5f98 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 51d3266a-292e-4fce-a594-e8cbda085c6e] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:07.569554 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-4d0a0047-9a5e-480e-b0ea-cfd206fe5f98 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:07.570181 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-4d0a0047-9a5e-480e-b0ea-cfd206fe5f98 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:07.571167 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-4d0a0047-9a5e-480e-b0ea-cfd206fe5f98 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:07.572159 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-4d0a0047-9a5e-480e-b0ea-cfd206fe5f98 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:07.597103 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-ecca9084-7e9d-48a9-86bb-61ecc24793c7 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db3cd25f4c94640854677709d10ccbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0e917f30d3430bb088ca3d0afe1a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:07.609548 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-ecca9084-7e9d-48a9-86bb-61ecc24793c7 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] 10.222.0.57 "GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d" status: 200 len: 1568 microversion: 2.1 time: 0.198203 Jun 07 09:37:07.620910 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 454/912] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:37:07 2022] GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d => generated 1568 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:37:07.626671 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-4d0a0047-9a5e-480e-b0ea-cfd206fe5f98 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/51d3266a-292e-4fce-a594-e8cbda085c6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074184 Jun 07 09:37:07.627439 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 459/913] 10.222.0.57 () {58 vars in 1301 bytes} [Tue Jun 7 09:37:07 2022] GET /compute/v2.1/servers/51d3266a-292e-4fce-a594-e8cbda085c6e/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 09:37:07.638075 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-41cee041-8456-4649-b714-cbffacac6e83 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:07.638582 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-41cee041-8456-4649-b714-cbffacac6e83 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 51d3266a-292e-4fce-a594-e8cbda085c6e] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:07.645756 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-41cee041-8456-4649-b714-cbffacac6e83 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:07.646244 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-41cee041-8456-4649-b714-cbffacac6e83 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:07.647240 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-41cee041-8456-4649-b714-cbffacac6e83 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:07.647832 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-41cee041-8456-4649-b714-cbffacac6e83 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:07.682011 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-41cee041-8456-4649-b714-cbffacac6e83 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/51d3266a-292e-4fce-a594-e8cbda085c6e/os-volume_attachments/553371e8-3151-40aa-b198-0864b3eaf8d6" status: 200 len: 194 microversion: 2.1 time: 0.048386 Jun 07 09:37:07.682633 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 455/914] 10.222.0.57 () {58 vars in 1412 bytes} [Tue Jun 7 09:37:07 2022] GET /compute/v2.1/servers/51d3266a-292e-4fce-a594-e8cbda085c6e/os-volume_attachments/553371e8-3151-40aa-b198-0864b3eaf8d6 => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:37:08.029319 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-42010e40-086e-4053-bf71-554271479705 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:08.029923 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-42010e40-086e-4053-bf71-554271479705 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 3cc1496a-defc-48eb-8e12-4b328dd6fa31] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:08.036368 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-42010e40-086e-4053-bf71-554271479705 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:08.036849 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-42010e40-086e-4053-bf71-554271479705 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:08.037595 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-42010e40-086e-4053-bf71-554271479705 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:08.038027 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-42010e40-086e-4053-bf71-554271479705 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:08.168981 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-42010e40-086e-4053-bf71-554271479705 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:08.177552 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-42010e40-086e-4053-bf71-554271479705 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:08.183438 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-42010e40-086e-4053-bf71-554271479705 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:08.183438 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-42010e40-086e-4053-bf71-554271479705 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31" status: 200 len: 1720 microversion: 2.20 time: 0.154857 Jun 07 09:37:08.183438 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 460/915] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:37:08 2022] GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:37:08.628792 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-99b70007-ee7b-4d7d-92c3-9c5f8cd5cc72 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:08.629369 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-99b70007-ee7b-4d7d-92c3-9c5f8cd5cc72 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] [instance: dd2acb94-efe3-4c28-b597-21b0cfa1f27d] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:08.636088 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-99b70007-ee7b-4d7d-92c3-9c5f8cd5cc72 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:08.640810 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-99b70007-ee7b-4d7d-92c3-9c5f8cd5cc72 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:08.640810 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-99b70007-ee7b-4d7d-92c3-9c5f8cd5cc72 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:08.640810 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-99b70007-ee7b-4d7d-92c3-9c5f8cd5cc72 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:08.770617 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-99b70007-ee7b-4d7d-92c3-9c5f8cd5cc72 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db3cd25f4c94640854677709d10ccbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0e917f30d3430bb088ca3d0afe1a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:08.779297 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-99b70007-ee7b-4d7d-92c3-9c5f8cd5cc72 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] 10.222.0.57 "GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d" status: 200 len: 1568 microversion: 2.1 time: 0.155440 Jun 07 09:37:08.779943 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 456/916] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:37:08 2022] GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:37:08.780941 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [req-c05a5555-aa1c-4795-8f8f-c17bac8052b7 req-d3d8ef6d-308d-494f-87b1-58040d22e937 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cc1496a-defc-48eb-8e12-4b328dd6fa31", "name": "network-vif-unplugged", "status": "completed", "tag": "f987791d-1369-4164-867a-29c6d0558f0c"}]} {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:37:08.789744 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [req-c05a5555-aa1c-4795-8f8f-c17bac8052b7 req-d3d8ef6d-308d-494f-87b1-58040d22e937 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:08.790187 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [req-c05a5555-aa1c-4795-8f8f-c17bac8052b7 req-d3d8ef6d-308d-494f-87b1-58040d22e937 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:08.801691 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.compute.server_external_events [req-c05a5555-aa1c-4795-8f8f-c17bac8052b7 req-d3d8ef6d-308d-494f-87b1-58040d22e937 service nova] Creating event network-vif-unplugged:f987791d-1369-4164-867a-29c6d0558f0c for instance 3cc1496a-defc-48eb-8e12-4b328dd6fa31 on hv-cinder-83699 Jun 07 09:37:08.806811 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [req-c05a5555-aa1c-4795-8f8f-c17bac8052b7 req-d3d8ef6d-308d-494f-87b1-58040d22e937 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030773 Jun 07 09:37:08.807401 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 461/917] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Jun 7 09:37:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 09:37:09.198412 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-28aeeba5-4854-42bf-8514-17cb530dd774 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:09.199025 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-28aeeba5-4854-42bf-8514-17cb530dd774 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 3cc1496a-defc-48eb-8e12-4b328dd6fa31] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:09.205468 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-28aeeba5-4854-42bf-8514-17cb530dd774 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:09.205924 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-28aeeba5-4854-42bf-8514-17cb530dd774 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:09.206700 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-28aeeba5-4854-42bf-8514-17cb530dd774 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:09.207207 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-28aeeba5-4854-42bf-8514-17cb530dd774 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:09.334411 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-28aeeba5-4854-42bf-8514-17cb530dd774 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:09.342419 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-28aeeba5-4854-42bf-8514-17cb530dd774 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:09.343910 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-28aeeba5-4854-42bf-8514-17cb530dd774 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:09.345719 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-28aeeba5-4854-42bf-8514-17cb530dd774 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31" status: 200 len: 1720 microversion: 2.20 time: 0.151289 Jun 07 09:37:09.346279 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 457/918] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:37:09 2022] GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31 => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:37:09.801733 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-6a89d10c-8c1c-4afe-bde2-03aa48147d4e tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:09.802450 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-6a89d10c-8c1c-4afe-bde2-03aa48147d4e tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] [instance: dd2acb94-efe3-4c28-b597-21b0cfa1f27d] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:09.809050 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-6a89d10c-8c1c-4afe-bde2-03aa48147d4e tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:09.809539 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-6a89d10c-8c1c-4afe-bde2-03aa48147d4e tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:09.815013 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-6a89d10c-8c1c-4afe-bde2-03aa48147d4e tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:09.815013 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-6a89d10c-8c1c-4afe-bde2-03aa48147d4e tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:09.939936 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-6a89d10c-8c1c-4afe-bde2-03aa48147d4e tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db3cd25f4c94640854677709d10ccbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0e917f30d3430bb088ca3d0afe1a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:09.947674 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-6a89d10c-8c1c-4afe-bde2-03aa48147d4e tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] 10.222.0.57 "GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d" status: 200 len: 1568 microversion: 2.1 time: 0.150949 Jun 07 09:37:09.948306 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 462/919] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:37:09 2022] GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:37:10.363726 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-fce26b6b-db9e-4a5b-85c1-e24d9a0693dc tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:10.364347 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-fce26b6b-db9e-4a5b-85c1-e24d9a0693dc tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 3cc1496a-defc-48eb-8e12-4b328dd6fa31] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:10.370787 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-fce26b6b-db9e-4a5b-85c1-e24d9a0693dc tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:10.371240 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-fce26b6b-db9e-4a5b-85c1-e24d9a0693dc tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:10.372011 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-fce26b6b-db9e-4a5b-85c1-e24d9a0693dc tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:10.372446 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-fce26b6b-db9e-4a5b-85c1-e24d9a0693dc tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:10.513684 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-fce26b6b-db9e-4a5b-85c1-e24d9a0693dc tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:10.518920 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-194a84dc-ca87-466a-82f4-e1baf940ae7f tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a58974f0-cfd1-4605-badf-42702b1d39fa"}} {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:37:10.519991 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-194a84dc-ca87-466a-82f4-e1baf940ae7f tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 51d3266a-292e-4fce-a594-e8cbda085c6e] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:10.521183 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-fce26b6b-db9e-4a5b-85c1-e24d9a0693dc tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:10.523102 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-fce26b6b-db9e-4a5b-85c1-e24d9a0693dc tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:10.524164 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-fce26b6b-db9e-4a5b-85c1-e24d9a0693dc tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31" status: 200 len: 1663 microversion: 2.20 time: 0.164914 Jun 07 09:37:10.531346 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 458/920] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:37:10 2022] GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31 => generated 1663 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:37:10.531485 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-194a84dc-ca87-466a-82f4-e1baf940ae7f tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:10.531485 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-194a84dc-ca87-466a-82f4-e1baf940ae7f tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:10.531485 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-194a84dc-ca87-466a-82f4-e1baf940ae7f tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:10.531485 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-194a84dc-ca87-466a-82f4-e1baf940ae7f tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:10.543230 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-bdb3e25a-a25e-4bc4-8039-d8e8be5834c0 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0e288657-31a6-4917-b674-56a6aeea105d"}} {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:37:10.545501 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-bdb3e25a-a25e-4bc4-8039-d8e8be5834c0 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 3cc1496a-defc-48eb-8e12-4b328dd6fa31] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:10.553548 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-bdb3e25a-a25e-4bc4-8039-d8e8be5834c0 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:10.554001 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-bdb3e25a-a25e-4bc4-8039-d8e8be5834c0 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:10.554821 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-bdb3e25a-a25e-4bc4-8039-d8e8be5834c0 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:10.555647 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-bdb3e25a-a25e-4bc4-8039-d8e8be5834c0 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:11.172361 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:37:11.650346 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-bdb3e25a-a25e-4bc4-8039-d8e8be5834c0 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "POST /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.111508 Jun 07 09:37:11.650960 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 459/921] 10.222.0.57 () {62 vars in 1363 bytes} [Tue Jun 7 09:37:10 2022] POST /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31/os-volume_attachments => generated 188 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 07 09:37:11.655543 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-4ce1a1e4-6c9f-44b1-ac82-d2f74ca7aca0 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:11.656160 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-4ce1a1e4-6c9f-44b1-ac82-d2f74ca7aca0 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] [instance: dd2acb94-efe3-4c28-b597-21b0cfa1f27d] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:11.663065 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-4ce1a1e4-6c9f-44b1-ac82-d2f74ca7aca0 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:11.663560 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-4ce1a1e4-6c9f-44b1-ac82-d2f74ca7aca0 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:11.664332 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-4ce1a1e4-6c9f-44b1-ac82-d2f74ca7aca0 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:11.664808 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-4ce1a1e4-6c9f-44b1-ac82-d2f74ca7aca0 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:11.803295 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-4ce1a1e4-6c9f-44b1-ac82-d2f74ca7aca0 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db3cd25f4c94640854677709d10ccbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0e917f30d3430bb088ca3d0afe1a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:11.810783 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-4ce1a1e4-6c9f-44b1-ac82-d2f74ca7aca0 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] 10.222.0.57 "GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d" status: 200 len: 1568 microversion: 2.1 time: 0.158886 Jun 07 09:37:11.811340 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 460/922] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:37:11 2022] GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:37:11.815932 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-fbc43529-e264-4542-a188-583d6c35e8f3 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:11.816414 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-fbc43529-e264-4542-a188-583d6c35e8f3 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 3cc1496a-defc-48eb-8e12-4b328dd6fa31] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:11.822776 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-fbc43529-e264-4542-a188-583d6c35e8f3 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:11.823238 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-fbc43529-e264-4542-a188-583d6c35e8f3 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:11.824012 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-fbc43529-e264-4542-a188-583d6c35e8f3 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:11.824457 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-fbc43529-e264-4542-a188-583d6c35e8f3 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:12.564858 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-fbc43529-e264-4542-a188-583d6c35e8f3 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "DELETE /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31/os-volume_attachments/0e288657-31a6-4917-b674-56a6aeea105d" status: 202 len: 0 microversion: 2.20 time: 0.752157 Jun 07 09:37:12.565570 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 461/923] 10.222.0.57 () {60 vars in 1456 bytes} [Tue Jun 7 09:37:11 2022] DELETE /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31/os-volume_attachments/0e288657-31a6-4917-b674-56a6aeea105d => generated 0 bytes in 754 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 07 09:37:12.629283 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-0399856e-b66d-4d22-8c6e-1e59a7d5ee84 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:37:12.629853 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-0399856e-b66d-4d22-8c6e-1e59a7d5ee84 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 3cc1496a-defc-48eb-8e12-4b328dd6fa31] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:12.637486 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-0399856e-b66d-4d22-8c6e-1e59a7d5ee84 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:12.637915 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-0399856e-b66d-4d22-8c6e-1e59a7d5ee84 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:12.638699 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-0399856e-b66d-4d22-8c6e-1e59a7d5ee84 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:12.639132 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-0399856e-b66d-4d22-8c6e-1e59a7d5ee84 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:12.660962 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-194a84dc-ca87-466a-82f4-e1baf940ae7f tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "POST /compute/v2.1/servers/51d3266a-292e-4fce-a594-e8cbda085c6e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.145694 Jun 07 09:37:12.662292 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 463/924] 10.222.0.57 () {60 vars in 1322 bytes} [Tue Jun 7 09:37:10 2022] POST /compute/v2.1/servers/51d3266a-292e-4fce-a594-e8cbda085c6e/os-volume_attachments => generated 194 bytes in 2148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 09:37:12.827820 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-9b114260-a971-48ff-86ef-a1938573cd6b tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:12.828661 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-9b114260-a971-48ff-86ef-a1938573cd6b tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] [instance: dd2acb94-efe3-4c28-b597-21b0cfa1f27d] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:12.835698 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-9b114260-a971-48ff-86ef-a1938573cd6b tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:12.836152 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-9b114260-a971-48ff-86ef-a1938573cd6b tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:12.836973 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-9b114260-a971-48ff-86ef-a1938573cd6b tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:12.837448 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-9b114260-a971-48ff-86ef-a1938573cd6b tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:12.965350 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-0399856e-b66d-4d22-8c6e-1e59a7d5ee84 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "POST /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31/action" status: 202 len: 0 microversion: 2.20 time: 0.340959 Jun 07 09:37:12.969335 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 462/925] 10.222.0.57 () {62 vars in 1318 bytes} [Tue Jun 7 09:37:12 2022] POST /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31/action => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 07 09:37:12.974822 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-210e43e1-0378-4684-aa7f-824ff699bd13 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:12.975769 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-210e43e1-0378-4684-aa7f-824ff699bd13 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 3cc1496a-defc-48eb-8e12-4b328dd6fa31] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:12.984944 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-210e43e1-0378-4684-aa7f-824ff699bd13 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:12.986126 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-210e43e1-0378-4684-aa7f-824ff699bd13 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:12.987434 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-210e43e1-0378-4684-aa7f-824ff699bd13 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:12.988165 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-210e43e1-0378-4684-aa7f-824ff699bd13 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:13.166252 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-210e43e1-0378-4684-aa7f-824ff699bd13 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:13.174749 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-210e43e1-0378-4684-aa7f-824ff699bd13 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:13.176276 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-210e43e1-0378-4684-aa7f-824ff699bd13 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:13.180150 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-210e43e1-0378-4684-aa7f-824ff699bd13 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31" status: 200 len: 1671 microversion: 2.20 time: 0.207074 Jun 07 09:37:13.180150 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 463/926] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:37:12 2022] GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31 => generated 1671 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:37:13.228909 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-9b114260-a971-48ff-86ef-a1938573cd6b tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db3cd25f4c94640854677709d10ccbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0e917f30d3430bb088ca3d0afe1a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:13.237210 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-9b114260-a971-48ff-86ef-a1938573cd6b tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] 10.222.0.57 "GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d" status: 200 len: 1568 microversion: 2.1 time: 0.413677 Jun 07 09:37:13.237766 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 464/927] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:37:12 2022] GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d => generated 1568 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:37:14.195840 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-8b81b7b5-4d1d-4f25-8ad1-75d9302f1a77 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:14.196509 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-8b81b7b5-4d1d-4f25-8ad1-75d9302f1a77 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 3cc1496a-defc-48eb-8e12-4b328dd6fa31] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:14.198889 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writing DB stats nova_api:SELECT=64 {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:37:14.203612 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-8b81b7b5-4d1d-4f25-8ad1-75d9302f1a77 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:14.204068 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-8b81b7b5-4d1d-4f25-8ad1-75d9302f1a77 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:14.204860 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-8b81b7b5-4d1d-4f25-8ad1-75d9302f1a77 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:14.205302 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-8b81b7b5-4d1d-4f25-8ad1-75d9302f1a77 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:14.254530 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-f4ae9898-5134-4c12-98e6-f2f000efaa72 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:14.255079 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-f4ae9898-5134-4c12-98e6-f2f000efaa72 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] [instance: dd2acb94-efe3-4c28-b597-21b0cfa1f27d] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:14.261504 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-f4ae9898-5134-4c12-98e6-f2f000efaa72 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:14.261961 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-f4ae9898-5134-4c12-98e6-f2f000efaa72 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:14.262727 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-f4ae9898-5134-4c12-98e6-f2f000efaa72 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:14.263164 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-f4ae9898-5134-4c12-98e6-f2f000efaa72 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:14.335662 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-8b81b7b5-4d1d-4f25-8ad1-75d9302f1a77 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:14.343701 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-8b81b7b5-4d1d-4f25-8ad1-75d9302f1a77 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:14.345793 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-8b81b7b5-4d1d-4f25-8ad1-75d9302f1a77 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:14.346988 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-8b81b7b5-4d1d-4f25-8ad1-75d9302f1a77 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31" status: 200 len: 1671 microversion: 2.20 time: 0.155058 Jun 07 09:37:14.347549 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 464/928] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:37:14 2022] GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31 => generated 1671 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:37:14.397085 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-f4ae9898-5134-4c12-98e6-f2f000efaa72 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db3cd25f4c94640854677709d10ccbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0e917f30d3430bb088ca3d0afe1a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:14.404766 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-f4ae9898-5134-4c12-98e6-f2f000efaa72 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] 10.222.0.57 "GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d" status: 200 len: 1568 microversion: 2.1 time: 0.154083 Jun 07 09:37:14.405328 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 465/929] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:37:14 2022] GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:37:14.808279 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [req-95221848-a65a-4566-b6ce-a47295e717ea req-f42af74d-80e1-40b1-aece-cab3f96db6f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd2acb94-efe3-4c28-b597-21b0cfa1f27d", "name": "network-vif-unplugged", "status": "completed", "tag": "b980d237-cae5-40fe-89ff-abe6de093fce"}]} {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:37:14.819579 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [req-95221848-a65a-4566-b6ce-a47295e717ea req-f42af74d-80e1-40b1-aece-cab3f96db6f1 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:14.820679 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [req-95221848-a65a-4566-b6ce-a47295e717ea req-f42af74d-80e1-40b1-aece-cab3f96db6f1 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:14.848628 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.compute.server_external_events [req-95221848-a65a-4566-b6ce-a47295e717ea req-f42af74d-80e1-40b1-aece-cab3f96db6f1 service nova] Creating event network-vif-unplugged:b980d237-cae5-40fe-89ff-abe6de093fce for instance dd2acb94-efe3-4c28-b597-21b0cfa1f27d on hv-cinder-83699 Jun 07 09:37:14.848628 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [req-95221848-a65a-4566-b6ce-a47295e717ea req-f42af74d-80e1-40b1-aece-cab3f96db6f1 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036983 Jun 07 09:37:14.848628 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 465/930] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Jun 7 09:37:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:37:15.365913 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-6509f4fa-5e52-45dc-a72c-98f9439b83a0 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:15.366443 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-6509f4fa-5e52-45dc-a72c-98f9439b83a0 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 3cc1496a-defc-48eb-8e12-4b328dd6fa31] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:15.372783 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-6509f4fa-5e52-45dc-a72c-98f9439b83a0 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:15.373227 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-6509f4fa-5e52-45dc-a72c-98f9439b83a0 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:15.373969 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-6509f4fa-5e52-45dc-a72c-98f9439b83a0 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:15.374397 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-6509f4fa-5e52-45dc-a72c-98f9439b83a0 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:15.423527 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-78380665-b437-42bf-9fd5-8b77b0112d37 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:15.424220 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-78380665-b437-42bf-9fd5-8b77b0112d37 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] [instance: dd2acb94-efe3-4c28-b597-21b0cfa1f27d] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:15.430452 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-78380665-b437-42bf-9fd5-8b77b0112d37 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:15.430900 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-78380665-b437-42bf-9fd5-8b77b0112d37 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:15.431654 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-78380665-b437-42bf-9fd5-8b77b0112d37 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:15.432087 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-78380665-b437-42bf-9fd5-8b77b0112d37 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:15.508104 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-6509f4fa-5e52-45dc-a72c-98f9439b83a0 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:15.512846 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-6509f4fa-5e52-45dc-a72c-98f9439b83a0 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:15.514346 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-6509f4fa-5e52-45dc-a72c-98f9439b83a0 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:15.515487 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-6509f4fa-5e52-45dc-a72c-98f9439b83a0 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31" status: 200 len: 1671 microversion: 2.20 time: 0.153580 Jun 07 09:37:15.516042 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 466/931] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:37:15 2022] GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31 => generated 1671 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:37:15.563765 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-78380665-b437-42bf-9fd5-8b77b0112d37 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db3cd25f4c94640854677709d10ccbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0e917f30d3430bb088ca3d0afe1a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:15.571499 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-78380665-b437-42bf-9fd5-8b77b0112d37 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] 10.222.0.57 "GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d" status: 200 len: 1568 microversion: 2.1 time: 0.152804 Jun 07 09:37:15.572064 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 466/932] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:37:15 2022] GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:37:16.534800 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-b0b5fff6-18c7-4ca3-9584-6424f0e38a4f tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:16.535454 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-b0b5fff6-18c7-4ca3-9584-6424f0e38a4f tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 3cc1496a-defc-48eb-8e12-4b328dd6fa31] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:16.542207 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b0b5fff6-18c7-4ca3-9584-6424f0e38a4f tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:16.542567 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b0b5fff6-18c7-4ca3-9584-6424f0e38a4f tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:16.543353 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b0b5fff6-18c7-4ca3-9584-6424f0e38a4f tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:16.543789 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b0b5fff6-18c7-4ca3-9584-6424f0e38a4f tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:16.588901 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-95a19e21-1bae-42e4-8a5c-ce3a187bf86c tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:16.592486 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-95a19e21-1bae-42e4-8a5c-ce3a187bf86c tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] [instance: dd2acb94-efe3-4c28-b597-21b0cfa1f27d] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:16.596356 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-95a19e21-1bae-42e4-8a5c-ce3a187bf86c tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:16.596871 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-95a19e21-1bae-42e4-8a5c-ce3a187bf86c tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:16.597643 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-95a19e21-1bae-42e4-8a5c-ce3a187bf86c tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:16.598078 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-95a19e21-1bae-42e4-8a5c-ce3a187bf86c tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:16.678971 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-b0b5fff6-18c7-4ca3-9584-6424f0e38a4f tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:16.684892 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-b0b5fff6-18c7-4ca3-9584-6424f0e38a4f tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:16.686406 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-b0b5fff6-18c7-4ca3-9584-6424f0e38a4f tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:16.687593 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-b0b5fff6-18c7-4ca3-9584-6424f0e38a4f tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31" status: 200 len: 1671 microversion: 2.20 time: 0.157128 Jun 07 09:37:16.688141 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 467/933] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:37:16 2022] GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31 => generated 1671 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:37:16.734972 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-95a19e21-1bae-42e4-8a5c-ce3a187bf86c tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db3cd25f4c94640854677709d10ccbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0e917f30d3430bb088ca3d0afe1a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:16.742761 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-95a19e21-1bae-42e4-8a5c-ce3a187bf86c tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] 10.222.0.57 "GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d" status: 200 len: 1568 microversion: 2.1 time: 0.157710 Jun 07 09:37:16.743318 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 467/934] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:37:16 2022] GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:37:17.705965 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-c9a29ad2-142c-4173-b414-0497ed785d77 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:17.706579 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-c9a29ad2-142c-4173-b414-0497ed785d77 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 3cc1496a-defc-48eb-8e12-4b328dd6fa31] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:17.713221 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-c9a29ad2-142c-4173-b414-0497ed785d77 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:17.713673 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-c9a29ad2-142c-4173-b414-0497ed785d77 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:17.714436 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-c9a29ad2-142c-4173-b414-0497ed785d77 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:17.714872 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-c9a29ad2-142c-4173-b414-0497ed785d77 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:17.759846 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-2c311a64-6bf5-4cb0-8b05-7b0345c0f0d1 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:17.760462 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-2c311a64-6bf5-4cb0-8b05-7b0345c0f0d1 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] [instance: dd2acb94-efe3-4c28-b597-21b0cfa1f27d] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:17.767077 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-2c311a64-6bf5-4cb0-8b05-7b0345c0f0d1 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:17.767618 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-2c311a64-6bf5-4cb0-8b05-7b0345c0f0d1 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:17.768458 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-2c311a64-6bf5-4cb0-8b05-7b0345c0f0d1 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:17.768928 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-2c311a64-6bf5-4cb0-8b05-7b0345c0f0d1 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:17.846013 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-c9a29ad2-142c-4173-b414-0497ed785d77 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:17.854422 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-c9a29ad2-142c-4173-b414-0497ed785d77 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:17.855912 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-c9a29ad2-142c-4173-b414-0497ed785d77 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:17.857092 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-c9a29ad2-142c-4173-b414-0497ed785d77 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31" status: 200 len: 1671 microversion: 2.20 time: 0.155067 Jun 07 09:37:17.857649 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 468/935] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:37:17 2022] GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31 => generated 1671 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:37:17.896831 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-2c311a64-6bf5-4cb0-8b05-7b0345c0f0d1 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db3cd25f4c94640854677709d10ccbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0e917f30d3430bb088ca3d0afe1a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:17.904349 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-2c311a64-6bf5-4cb0-8b05-7b0345c0f0d1 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] 10.222.0.57 "GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d" status: 200 len: 1568 microversion: 2.1 time: 0.148646 Jun 07 09:37:17.904950 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 468/936] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:37:17 2022] GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:37:18.876251 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-a578a4e1-349f-4168-9ff1-c93d9ce41e72 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:18.876883 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-a578a4e1-349f-4168-9ff1-c93d9ce41e72 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 3cc1496a-defc-48eb-8e12-4b328dd6fa31] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:18.883373 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-a578a4e1-349f-4168-9ff1-c93d9ce41e72 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:18.884031 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-a578a4e1-349f-4168-9ff1-c93d9ce41e72 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:18.884820 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-a578a4e1-349f-4168-9ff1-c93d9ce41e72 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:18.885283 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-a578a4e1-349f-4168-9ff1-c93d9ce41e72 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:18.921024 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-95da7232-780f-439e-9bcd-a623c1ce776d tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:18.921666 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-95da7232-780f-439e-9bcd-a623c1ce776d tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] [instance: dd2acb94-efe3-4c28-b597-21b0cfa1f27d] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:18.928841 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-95da7232-780f-439e-9bcd-a623c1ce776d tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:18.929296 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-95da7232-780f-439e-9bcd-a623c1ce776d tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:18.930064 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-95da7232-780f-439e-9bcd-a623c1ce776d tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:18.930500 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-95da7232-780f-439e-9bcd-a623c1ce776d tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:19.017553 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-a578a4e1-349f-4168-9ff1-c93d9ce41e72 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:19.027206 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-a578a4e1-349f-4168-9ff1-c93d9ce41e72 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:19.028528 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-a578a4e1-349f-4168-9ff1-c93d9ce41e72 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:19.029707 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-a578a4e1-349f-4168-9ff1-c93d9ce41e72 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31" status: 200 len: 1671 microversion: 2.20 time: 0.157916 Jun 07 09:37:19.030257 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 469/937] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:37:18 2022] GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31 => generated 1671 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 09:37:19.082788 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-95da7232-780f-439e-9bcd-a623c1ce776d tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db3cd25f4c94640854677709d10ccbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0e917f30d3430bb088ca3d0afe1a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:19.090781 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-95da7232-780f-439e-9bcd-a623c1ce776d tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] 10.222.0.57 "GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d" status: 200 len: 1568 microversion: 2.1 time: 0.173507 Jun 07 09:37:19.091278 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 469/938] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:37:18 2022] GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d => generated 1568 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:37:20.047728 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-a3b84828-39d2-4886-a917-e6fd5ab1549b tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:20.048330 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-a3b84828-39d2-4886-a917-e6fd5ab1549b tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 3cc1496a-defc-48eb-8e12-4b328dd6fa31] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:20.054818 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-a3b84828-39d2-4886-a917-e6fd5ab1549b tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:20.055258 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-a3b84828-39d2-4886-a917-e6fd5ab1549b tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:20.056005 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-a3b84828-39d2-4886-a917-e6fd5ab1549b tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:20.056438 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-a3b84828-39d2-4886-a917-e6fd5ab1549b tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:20.107463 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-345d2a9c-b33c-47e1-82b1-4d77af2e3a03 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:20.108085 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-345d2a9c-b33c-47e1-82b1-4d77af2e3a03 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] [instance: dd2acb94-efe3-4c28-b597-21b0cfa1f27d] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:20.115006 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-345d2a9c-b33c-47e1-82b1-4d77af2e3a03 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:20.115459 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-345d2a9c-b33c-47e1-82b1-4d77af2e3a03 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:20.116237 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-345d2a9c-b33c-47e1-82b1-4d77af2e3a03 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:20.116751 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-345d2a9c-b33c-47e1-82b1-4d77af2e3a03 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:20.200266 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-a3b84828-39d2-4886-a917-e6fd5ab1549b tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:20.208944 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-a3b84828-39d2-4886-a917-e6fd5ab1549b tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:20.210425 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-a3b84828-39d2-4886-a917-e6fd5ab1549b tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:20.211563 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-a3b84828-39d2-4886-a917-e6fd5ab1549b tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31" status: 200 len: 1671 microversion: 2.20 time: 0.167661 Jun 07 09:37:20.212107 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 470/939] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:37:20 2022] GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31 => generated 1671 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:37:20.252987 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-345d2a9c-b33c-47e1-82b1-4d77af2e3a03 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db3cd25f4c94640854677709d10ccbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0e917f30d3430bb088ca3d0afe1a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:20.260653 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-345d2a9c-b33c-47e1-82b1-4d77af2e3a03 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] 10.222.0.57 "GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d" status: 200 len: 1568 microversion: 2.1 time: 0.156885 Jun 07 09:37:20.261141 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 470/940] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:37:20 2022] GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:37:21.230468 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-8fd02e15-646c-4088-82ea-089ccadef0e6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:21.231073 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-8fd02e15-646c-4088-82ea-089ccadef0e6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 3cc1496a-defc-48eb-8e12-4b328dd6fa31] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:21.237419 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-8fd02e15-646c-4088-82ea-089ccadef0e6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:21.237872 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-8fd02e15-646c-4088-82ea-089ccadef0e6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:21.238624 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-8fd02e15-646c-4088-82ea-089ccadef0e6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:21.239054 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-8fd02e15-646c-4088-82ea-089ccadef0e6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:21.278545 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-80871884-fade-40da-9e13-04201d1f1801 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:21.279103 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-80871884-fade-40da-9e13-04201d1f1801 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] [instance: dd2acb94-efe3-4c28-b597-21b0cfa1f27d] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:21.285782 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-80871884-fade-40da-9e13-04201d1f1801 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:21.286230 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-80871884-fade-40da-9e13-04201d1f1801 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:21.287192 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-80871884-fade-40da-9e13-04201d1f1801 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:21.287636 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-80871884-fade-40da-9e13-04201d1f1801 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:21.378349 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-8fd02e15-646c-4088-82ea-089ccadef0e6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:21.387794 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-8fd02e15-646c-4088-82ea-089ccadef0e6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:21.389429 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-8fd02e15-646c-4088-82ea-089ccadef0e6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:21.390774 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-8fd02e15-646c-4088-82ea-089ccadef0e6 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31" status: 200 len: 1671 microversion: 2.20 time: 0.164373 Jun 07 09:37:21.392031 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 471/941] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:37:21 2022] GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31 => generated 1671 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:37:21.433484 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-80871884-fade-40da-9e13-04201d1f1801 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db3cd25f4c94640854677709d10ccbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0e917f30d3430bb088ca3d0afe1a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:21.441340 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-80871884-fade-40da-9e13-04201d1f1801 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] 10.222.0.57 "GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d" status: 200 len: 1568 microversion: 2.1 time: 0.166619 Jun 07 09:37:21.441930 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 471/942] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:37:21 2022] GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:37:22.410427 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-792b3e6a-3044-42c4-9e43-cd3df1c7ada7 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:22.411667 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-792b3e6a-3044-42c4-9e43-cd3df1c7ada7 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 3cc1496a-defc-48eb-8e12-4b328dd6fa31] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:22.418616 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-792b3e6a-3044-42c4-9e43-cd3df1c7ada7 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:22.419143 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-792b3e6a-3044-42c4-9e43-cd3df1c7ada7 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:22.419892 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-792b3e6a-3044-42c4-9e43-cd3df1c7ada7 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:22.420510 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-792b3e6a-3044-42c4-9e43-cd3df1c7ada7 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:22.461296 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-615ca68d-e769-41cf-9c8b-7e446bea6eb2 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:22.463057 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-615ca68d-e769-41cf-9c8b-7e446bea6eb2 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] [instance: dd2acb94-efe3-4c28-b597-21b0cfa1f27d] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:22.474307 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-615ca68d-e769-41cf-9c8b-7e446bea6eb2 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:22.475014 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-615ca68d-e769-41cf-9c8b-7e446bea6eb2 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:22.476011 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-615ca68d-e769-41cf-9c8b-7e446bea6eb2 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:22.477255 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-615ca68d-e769-41cf-9c8b-7e446bea6eb2 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:22.497048 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=8,nova_cell1:INSERT=4 {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:37:22.592799 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-792b3e6a-3044-42c4-9e43-cd3df1c7ada7 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:22.606328 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-792b3e6a-3044-42c4-9e43-cd3df1c7ada7 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:22.608344 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-792b3e6a-3044-42c4-9e43-cd3df1c7ada7 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:22.609721 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-792b3e6a-3044-42c4-9e43-cd3df1c7ada7 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31" status: 200 len: 1671 microversion: 2.20 time: 0.203871 Jun 07 09:37:22.611028 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 472/943] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:37:22 2022] GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31 => generated 1671 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:37:22.651589 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-615ca68d-e769-41cf-9c8b-7e446bea6eb2 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db3cd25f4c94640854677709d10ccbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0e917f30d3430bb088ca3d0afe1a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:22.659927 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-615ca68d-e769-41cf-9c8b-7e446bea6eb2 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] 10.222.0.57 "GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d" status: 200 len: 1568 microversion: 2.1 time: 0.202942 Jun 07 09:37:22.660478 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 472/944] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:37:22 2022] GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d => generated 1568 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:37:23.629252 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-6d09774c-1439-43a9-8cf5-26954bcea75a tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:23.629964 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-6d09774c-1439-43a9-8cf5-26954bcea75a tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 3cc1496a-defc-48eb-8e12-4b328dd6fa31] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:23.636533 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-6d09774c-1439-43a9-8cf5-26954bcea75a tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:23.637026 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-6d09774c-1439-43a9-8cf5-26954bcea75a tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:23.637782 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-6d09774c-1439-43a9-8cf5-26954bcea75a tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:23.638204 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-6d09774c-1439-43a9-8cf5-26954bcea75a tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:23.677079 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-ff36574a-1b94-4d1d-82f8-c92bb17a43c5 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:23.677702 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-ff36574a-1b94-4d1d-82f8-c92bb17a43c5 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] [instance: dd2acb94-efe3-4c28-b597-21b0cfa1f27d] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:23.684511 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-ff36574a-1b94-4d1d-82f8-c92bb17a43c5 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:23.684996 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-ff36574a-1b94-4d1d-82f8-c92bb17a43c5 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:23.685793 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-ff36574a-1b94-4d1d-82f8-c92bb17a43c5 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:23.686243 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-ff36574a-1b94-4d1d-82f8-c92bb17a43c5 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:23.788030 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-6d09774c-1439-43a9-8cf5-26954bcea75a tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:23.795911 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-6d09774c-1439-43a9-8cf5-26954bcea75a tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:23.797952 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-6d09774c-1439-43a9-8cf5-26954bcea75a tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:23.799092 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-6d09774c-1439-43a9-8cf5-26954bcea75a tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31" status: 200 len: 1729 microversion: 2.20 time: 0.174410 Jun 07 09:37:23.805072 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 473/945] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:37:23 2022] GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31 => generated 1729 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:37:23.823975 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-ff36574a-1b94-4d1d-82f8-c92bb17a43c5 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db3cd25f4c94640854677709d10ccbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0e917f30d3430bb088ca3d0afe1a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:23.831739 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-ff36574a-1b94-4d1d-82f8-c92bb17a43c5 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] 10.222.0.57 "GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d" status: 200 len: 1569 microversion: 2.1 time: 0.158584 Jun 07 09:37:23.833840 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 473/946] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:37:23 2022] GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:37:23.848207 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-b4c0760a-89aa-47e5-8317-d03c4f9477bb tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:37:23.848748 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-b4c0760a-89aa-47e5-8317-d03c4f9477bb tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] [instance: dd2acb94-efe3-4c28-b597-21b0cfa1f27d] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:23.855290 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b4c0760a-89aa-47e5-8317-d03c4f9477bb tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:23.855820 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b4c0760a-89aa-47e5-8317-d03c4f9477bb tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:23.856746 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b4c0760a-89aa-47e5-8317-d03c4f9477bb tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:23.857210 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b4c0760a-89aa-47e5-8317-d03c4f9477bb tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:23.861775 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:37:24.117357 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-b4c0760a-89aa-47e5-8317-d03c4f9477bb tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] 10.222.0.57 "POST /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d/action" status: 202 len: 0 microversion: 2.1 time: 0.272946 Jun 07 09:37:24.117950 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 474/947] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Jun 7 09:37:23 2022] POST /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d/action => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 09:37:24.126370 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-a3a7577b-1f62-4e4e-a1e1-218cc27e7edc tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:24.127018 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-a3a7577b-1f62-4e4e-a1e1-218cc27e7edc tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] [instance: dd2acb94-efe3-4c28-b597-21b0cfa1f27d] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:24.133712 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-a3a7577b-1f62-4e4e-a1e1-218cc27e7edc tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:24.134167 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-a3a7577b-1f62-4e4e-a1e1-218cc27e7edc tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:24.135059 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-a3a7577b-1f62-4e4e-a1e1-218cc27e7edc tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:24.135508 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-a3a7577b-1f62-4e4e-a1e1-218cc27e7edc tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:24.285390 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-a3a7577b-1f62-4e4e-a1e1-218cc27e7edc tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db3cd25f4c94640854677709d10ccbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0e917f30d3430bb088ca3d0afe1a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:24.293824 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-a3a7577b-1f62-4e4e-a1e1-218cc27e7edc tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] 10.222.0.57 "GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d" status: 200 len: 1577 microversion: 2.1 time: 0.171687 Jun 07 09:37:24.294478 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 474/948] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:37:24 2022] GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d => generated 1577 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:37:24.818889 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-eedf0158-7f01-4336-b1b0-16eeef1cc0e9 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:24.819514 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-eedf0158-7f01-4336-b1b0-16eeef1cc0e9 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 3cc1496a-defc-48eb-8e12-4b328dd6fa31] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:24.821813 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writing DB stats nova_api:SELECT=60 {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:37:24.827008 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-eedf0158-7f01-4336-b1b0-16eeef1cc0e9 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:24.827456 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-eedf0158-7f01-4336-b1b0-16eeef1cc0e9 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:24.828203 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-eedf0158-7f01-4336-b1b0-16eeef1cc0e9 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:24.828654 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-eedf0158-7f01-4336-b1b0-16eeef1cc0e9 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:25.043837 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-eedf0158-7f01-4336-b1b0-16eeef1cc0e9 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:25.052842 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-eedf0158-7f01-4336-b1b0-16eeef1cc0e9 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:25.054377 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-eedf0158-7f01-4336-b1b0-16eeef1cc0e9 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:25.055682 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-eedf0158-7f01-4336-b1b0-16eeef1cc0e9 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31" status: 200 len: 1729 microversion: 2.20 time: 0.241267 Jun 07 09:37:25.056241 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 475/949] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:37:24 2022] GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31 => generated 1729 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:37:25.311859 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-a1a4fe8c-1b4f-4ad2-976b-f4749b0dea1d tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:25.313317 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-a1a4fe8c-1b4f-4ad2-976b-f4749b0dea1d tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] [instance: dd2acb94-efe3-4c28-b597-21b0cfa1f27d] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:25.320329 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-a1a4fe8c-1b4f-4ad2-976b-f4749b0dea1d tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:25.320911 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-a1a4fe8c-1b4f-4ad2-976b-f4749b0dea1d tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:25.321694 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-a1a4fe8c-1b4f-4ad2-976b-f4749b0dea1d tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:25.322134 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-a1a4fe8c-1b4f-4ad2-976b-f4749b0dea1d tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:25.466486 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-a1a4fe8c-1b4f-4ad2-976b-f4749b0dea1d tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db3cd25f4c94640854677709d10ccbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0e917f30d3430bb088ca3d0afe1a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:25.475927 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-a1a4fe8c-1b4f-4ad2-976b-f4749b0dea1d tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] 10.222.0.57 "GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d" status: 200 len: 1517 microversion: 2.1 time: 0.168257 Jun 07 09:37:25.477122 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 475/950] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:37:25 2022] GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d => generated 1517 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:37:26.074245 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-4a7bcc28-53cf-416f-8a52-972159574b46 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:26.074847 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-4a7bcc28-53cf-416f-8a52-972159574b46 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 3cc1496a-defc-48eb-8e12-4b328dd6fa31] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:26.081658 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-4a7bcc28-53cf-416f-8a52-972159574b46 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:26.082104 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-4a7bcc28-53cf-416f-8a52-972159574b46 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:26.082853 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-4a7bcc28-53cf-416f-8a52-972159574b46 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:26.083287 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-4a7bcc28-53cf-416f-8a52-972159574b46 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:26.230357 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-4a7bcc28-53cf-416f-8a52-972159574b46 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:26.239440 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-4a7bcc28-53cf-416f-8a52-972159574b46 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:26.240994 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-4a7bcc28-53cf-416f-8a52-972159574b46 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:26.242276 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-4a7bcc28-53cf-416f-8a52-972159574b46 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31" status: 200 len: 1729 microversion: 2.20 time: 0.172440 Jun 07 09:37:26.246119 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 476/951] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:37:26 2022] GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31 => generated 1729 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:37:26.495548 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-b221d168-467c-4f95-b742-b9f1e53bd1d0 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:26.496159 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-b221d168-467c-4f95-b742-b9f1e53bd1d0 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] [instance: dd2acb94-efe3-4c28-b597-21b0cfa1f27d] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:26.503113 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b221d168-467c-4f95-b742-b9f1e53bd1d0 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:26.503571 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b221d168-467c-4f95-b742-b9f1e53bd1d0 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:26.506691 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b221d168-467c-4f95-b742-b9f1e53bd1d0 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:26.506691 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b221d168-467c-4f95-b742-b9f1e53bd1d0 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:26.717767 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-b221d168-467c-4f95-b742-b9f1e53bd1d0 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db3cd25f4c94640854677709d10ccbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0e917f30d3430bb088ca3d0afe1a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:26.726463 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-b221d168-467c-4f95-b742-b9f1e53bd1d0 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] 10.222.0.57 "GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d" status: 200 len: 1517 microversion: 2.1 time: 0.235275 Jun 07 09:37:26.727554 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 476/952] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:37:26 2022] GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d => generated 1517 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:37:27.261227 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-4a44f167-ef17-4aec-bb74-f667bdc6bd8b tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:27.261777 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-4a44f167-ef17-4aec-bb74-f667bdc6bd8b tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 3cc1496a-defc-48eb-8e12-4b328dd6fa31] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:27.269540 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-4a44f167-ef17-4aec-bb74-f667bdc6bd8b tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:27.269991 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-4a44f167-ef17-4aec-bb74-f667bdc6bd8b tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:27.270759 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-4a44f167-ef17-4aec-bb74-f667bdc6bd8b tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:27.271196 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-4a44f167-ef17-4aec-bb74-f667bdc6bd8b tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:27.406468 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-4a44f167-ef17-4aec-bb74-f667bdc6bd8b tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:27.414812 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-4a44f167-ef17-4aec-bb74-f667bdc6bd8b tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:27.416332 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-4a44f167-ef17-4aec-bb74-f667bdc6bd8b tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:27.417500 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-4a44f167-ef17-4aec-bb74-f667bdc6bd8b tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31" status: 200 len: 1729 microversion: 2.20 time: 0.160351 Jun 07 09:37:27.418045 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 477/953] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:37:27 2022] GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:37:27.746043 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-2aeca4a2-587d-4677-8a99-ab9bb5a1dc59 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:27.746640 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-2aeca4a2-587d-4677-8a99-ab9bb5a1dc59 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] [instance: dd2acb94-efe3-4c28-b597-21b0cfa1f27d] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:27.754882 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-2aeca4a2-587d-4677-8a99-ab9bb5a1dc59 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:27.755586 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-2aeca4a2-587d-4677-8a99-ab9bb5a1dc59 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:27.756376 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-2aeca4a2-587d-4677-8a99-ab9bb5a1dc59 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:27.756921 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-2aeca4a2-587d-4677-8a99-ab9bb5a1dc59 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:27.929017 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-2aeca4a2-587d-4677-8a99-ab9bb5a1dc59 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db3cd25f4c94640854677709d10ccbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0e917f30d3430bb088ca3d0afe1a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:27.940205 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-2aeca4a2-587d-4677-8a99-ab9bb5a1dc59 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] 10.222.0.57 "GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d" status: 200 len: 1517 microversion: 2.1 time: 0.198518 Jun 07 09:37:27.941440 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 477/954] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:37:27 2022] GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d => generated 1517 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:37:28.441186 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-5fa22fb9-232f-41ad-b2a2-e4fb455cbc20 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:28.442789 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-5fa22fb9-232f-41ad-b2a2-e4fb455cbc20 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 3cc1496a-defc-48eb-8e12-4b328dd6fa31] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:28.460963 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-5fa22fb9-232f-41ad-b2a2-e4fb455cbc20 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:28.461773 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-5fa22fb9-232f-41ad-b2a2-e4fb455cbc20 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:28.462805 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-5fa22fb9-232f-41ad-b2a2-e4fb455cbc20 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:28.463458 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-5fa22fb9-232f-41ad-b2a2-e4fb455cbc20 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:28.649102 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-5fa22fb9-232f-41ad-b2a2-e4fb455cbc20 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:28.649102 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-5fa22fb9-232f-41ad-b2a2-e4fb455cbc20 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:28.649918 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-5fa22fb9-232f-41ad-b2a2-e4fb455cbc20 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:28.651133 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-5fa22fb9-232f-41ad-b2a2-e4fb455cbc20 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31" status: 200 len: 1729 microversion: 2.20 time: 0.216328 Jun 07 09:37:28.651875 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 478/955] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:37:28 2022] GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31 => generated 1729 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:37:28.958378 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-97b6fe32-7636-4c81-bbe1-3037fa6ee173 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:28.959651 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-97b6fe32-7636-4c81-bbe1-3037fa6ee173 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] [instance: dd2acb94-efe3-4c28-b597-21b0cfa1f27d] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:28.966447 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-97b6fe32-7636-4c81-bbe1-3037fa6ee173 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:28.967465 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-97b6fe32-7636-4c81-bbe1-3037fa6ee173 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:28.968433 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-97b6fe32-7636-4c81-bbe1-3037fa6ee173 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:28.969595 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-97b6fe32-7636-4c81-bbe1-3037fa6ee173 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:29.127541 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-97b6fe32-7636-4c81-bbe1-3037fa6ee173 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db3cd25f4c94640854677709d10ccbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0e917f30d3430bb088ca3d0afe1a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:29.135917 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-97b6fe32-7636-4c81-bbe1-3037fa6ee173 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] 10.222.0.57 "GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d" status: 200 len: 1517 microversion: 2.1 time: 0.181637 Jun 07 09:37:29.138623 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 478/956] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:37:28 2022] GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d => generated 1517 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:37:29.670624 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-ef28302e-b7cb-4cca-a13d-b79c7da53485 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:29.671269 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-ef28302e-b7cb-4cca-a13d-b79c7da53485 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 3cc1496a-defc-48eb-8e12-4b328dd6fa31] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:29.679193 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-ef28302e-b7cb-4cca-a13d-b79c7da53485 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:29.679636 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-ef28302e-b7cb-4cca-a13d-b79c7da53485 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:29.680633 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-ef28302e-b7cb-4cca-a13d-b79c7da53485 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:29.681216 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-ef28302e-b7cb-4cca-a13d-b79c7da53485 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:29.834268 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-ef28302e-b7cb-4cca-a13d-b79c7da53485 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:29.842624 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-ef28302e-b7cb-4cca-a13d-b79c7da53485 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:29.845197 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-ef28302e-b7cb-4cca-a13d-b79c7da53485 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:29.846620 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-ef28302e-b7cb-4cca-a13d-b79c7da53485 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31" status: 200 len: 1729 microversion: 2.20 time: 0.180109 Jun 07 09:37:29.847282 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 479/957] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:37:29 2022] GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31 => generated 1729 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:37:30.153429 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-f31cefa5-50e4-433d-9898-f15ae1ce0cd4 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:30.154038 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-f31cefa5-50e4-433d-9898-f15ae1ce0cd4 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] [instance: dd2acb94-efe3-4c28-b597-21b0cfa1f27d] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:30.161142 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-f31cefa5-50e4-433d-9898-f15ae1ce0cd4 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:30.161591 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-f31cefa5-50e4-433d-9898-f15ae1ce0cd4 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:30.162365 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-f31cefa5-50e4-433d-9898-f15ae1ce0cd4 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:30.162800 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-f31cefa5-50e4-433d-9898-f15ae1ce0cd4 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:30.303885 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-f31cefa5-50e4-433d-9898-f15ae1ce0cd4 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db3cd25f4c94640854677709d10ccbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0e917f30d3430bb088ca3d0afe1a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:30.311985 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-f31cefa5-50e4-433d-9898-f15ae1ce0cd4 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] 10.222.0.57 "GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d" status: 200 len: 1517 microversion: 2.1 time: 0.162517 Jun 07 09:37:30.313065 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 479/958] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:37:30 2022] GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d => generated 1517 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:37:30.867133 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-c9d63012-0322-47cb-a54a-c5f1039882d2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:30.867742 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-c9d63012-0322-47cb-a54a-c5f1039882d2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 3cc1496a-defc-48eb-8e12-4b328dd6fa31] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:30.879585 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-c9d63012-0322-47cb-a54a-c5f1039882d2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:30.880034 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-c9d63012-0322-47cb-a54a-c5f1039882d2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:30.881246 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-c9d63012-0322-47cb-a54a-c5f1039882d2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:30.881937 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-c9d63012-0322-47cb-a54a-c5f1039882d2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:31.018837 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-c9d63012-0322-47cb-a54a-c5f1039882d2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:31.027757 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-c9d63012-0322-47cb-a54a-c5f1039882d2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:31.029319 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-c9d63012-0322-47cb-a54a-c5f1039882d2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:31.030483 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-c9d63012-0322-47cb-a54a-c5f1039882d2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31" status: 200 len: 1729 microversion: 2.20 time: 0.167990 Jun 07 09:37:31.031230 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 480/959] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:37:30 2022] GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31 => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:37:31.330160 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-b09c47c0-cc1a-4c8c-b7f8-bf0317d95a3b tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:31.330776 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-b09c47c0-cc1a-4c8c-b7f8-bf0317d95a3b tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] [instance: dd2acb94-efe3-4c28-b597-21b0cfa1f27d] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:31.337306 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b09c47c0-cc1a-4c8c-b7f8-bf0317d95a3b tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:31.337765 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b09c47c0-cc1a-4c8c-b7f8-bf0317d95a3b tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:31.338534 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b09c47c0-cc1a-4c8c-b7f8-bf0317d95a3b tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:31.338987 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b09c47c0-cc1a-4c8c-b7f8-bf0317d95a3b tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:31.471964 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-b09c47c0-cc1a-4c8c-b7f8-bf0317d95a3b tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db3cd25f4c94640854677709d10ccbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0e917f30d3430bb088ca3d0afe1a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:31.480562 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-b09c47c0-cc1a-4c8c-b7f8-bf0317d95a3b tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] 10.222.0.57 "GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d" status: 200 len: 1517 microversion: 2.1 time: 0.154675 Jun 07 09:37:31.481164 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 480/960] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:37:31 2022] GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d => generated 1517 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:37:32.050060 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-fba13844-8443-4d4a-ae93-a48c54f68b3a tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:32.050852 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-fba13844-8443-4d4a-ae93-a48c54f68b3a tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 3cc1496a-defc-48eb-8e12-4b328dd6fa31] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:32.057992 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-fba13844-8443-4d4a-ae93-a48c54f68b3a tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:32.058647 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-fba13844-8443-4d4a-ae93-a48c54f68b3a tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:32.059691 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-fba13844-8443-4d4a-ae93-a48c54f68b3a tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:32.060129 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-fba13844-8443-4d4a-ae93-a48c54f68b3a tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:32.197007 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-fba13844-8443-4d4a-ae93-a48c54f68b3a tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:32.206395 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-fba13844-8443-4d4a-ae93-a48c54f68b3a tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:32.207906 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-fba13844-8443-4d4a-ae93-a48c54f68b3a tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:32.209278 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-fba13844-8443-4d4a-ae93-a48c54f68b3a tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31" status: 200 len: 1729 microversion: 2.20 time: 0.163692 Jun 07 09:37:32.215434 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 481/961] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:37:32 2022] GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31 => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:37:32.498569 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-67386553-596d-4143-94b7-e29e6fef9810 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:32.499242 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-67386553-596d-4143-94b7-e29e6fef9810 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] [instance: dd2acb94-efe3-4c28-b597-21b0cfa1f27d] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:32.505793 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-67386553-596d-4143-94b7-e29e6fef9810 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:32.506232 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-67386553-596d-4143-94b7-e29e6fef9810 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:32.506998 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-67386553-596d-4143-94b7-e29e6fef9810 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:32.507429 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-67386553-596d-4143-94b7-e29e6fef9810 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:32.647443 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-67386553-596d-4143-94b7-e29e6fef9810 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db3cd25f4c94640854677709d10ccbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0e917f30d3430bb088ca3d0afe1a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:32.652443 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-67386553-596d-4143-94b7-e29e6fef9810 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] 10.222.0.57 "GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d" status: 200 len: 1517 microversion: 2.1 time: 0.157811 Jun 07 09:37:32.653031 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 481/962] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:37:32 2022] GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d => generated 1517 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:37:33.227729 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-0010905d-fc18-4ed3-af56-b92e78067e70 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:33.228978 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-0010905d-fc18-4ed3-af56-b92e78067e70 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 3cc1496a-defc-48eb-8e12-4b328dd6fa31] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:33.235481 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-0010905d-fc18-4ed3-af56-b92e78067e70 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:33.236004 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-0010905d-fc18-4ed3-af56-b92e78067e70 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:33.236789 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-0010905d-fc18-4ed3-af56-b92e78067e70 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:33.237217 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-0010905d-fc18-4ed3-af56-b92e78067e70 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:33.372275 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-0010905d-fc18-4ed3-af56-b92e78067e70 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:33.380845 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-0010905d-fc18-4ed3-af56-b92e78067e70 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:33.382427 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-0010905d-fc18-4ed3-af56-b92e78067e70 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:33.383578 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-0010905d-fc18-4ed3-af56-b92e78067e70 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31" status: 200 len: 1729 microversion: 2.20 time: 0.160054 Jun 07 09:37:33.384129 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 482/963] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:37:33 2022] GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:37:33.670093 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-ba0d9a4a-3e6a-4773-906e-312ec8b04886 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:33.670812 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-ba0d9a4a-3e6a-4773-906e-312ec8b04886 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] [instance: dd2acb94-efe3-4c28-b597-21b0cfa1f27d] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:33.678082 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-ba0d9a4a-3e6a-4773-906e-312ec8b04886 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:33.678537 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-ba0d9a4a-3e6a-4773-906e-312ec8b04886 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:33.679306 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-ba0d9a4a-3e6a-4773-906e-312ec8b04886 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:33.679750 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-ba0d9a4a-3e6a-4773-906e-312ec8b04886 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:33.805993 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-ba0d9a4a-3e6a-4773-906e-312ec8b04886 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db3cd25f4c94640854677709d10ccbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0e917f30d3430bb088ca3d0afe1a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:33.814117 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-ba0d9a4a-3e6a-4773-906e-312ec8b04886 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] 10.222.0.57 "GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d" status: 200 len: 1517 microversion: 2.1 time: 0.147570 Jun 07 09:37:33.814705 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 482/964] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:37:33 2022] GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d => generated 1517 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:37:34.402299 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-1f7c2176-464e-4fd5-b388-9a660cc619e2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:34.402832 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-1f7c2176-464e-4fd5-b388-9a660cc619e2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 3cc1496a-defc-48eb-8e12-4b328dd6fa31] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:34.409930 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-1f7c2176-464e-4fd5-b388-9a660cc619e2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:34.410380 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-1f7c2176-464e-4fd5-b388-9a660cc619e2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:34.411133 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-1f7c2176-464e-4fd5-b388-9a660cc619e2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:34.411568 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-1f7c2176-464e-4fd5-b388-9a660cc619e2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:34.537640 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-1f7c2176-464e-4fd5-b388-9a660cc619e2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:34.545426 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-1f7c2176-464e-4fd5-b388-9a660cc619e2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:34.546926 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-1f7c2176-464e-4fd5-b388-9a660cc619e2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:34.548558 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-1f7c2176-464e-4fd5-b388-9a660cc619e2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31" status: 200 len: 1729 microversion: 2.20 time: 0.149780 Jun 07 09:37:34.549133 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 483/965] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:37:34 2022] GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31 => generated 1729 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:37:34.832045 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-d17f1a78-c0a4-4654-8bfc-fc8c34452bf8 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:34.832698 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-d17f1a78-c0a4-4654-8bfc-fc8c34452bf8 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] [instance: dd2acb94-efe3-4c28-b597-21b0cfa1f27d] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:34.839423 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-d17f1a78-c0a4-4654-8bfc-fc8c34452bf8 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:34.847395 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-d17f1a78-c0a4-4654-8bfc-fc8c34452bf8 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:34.847395 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-d17f1a78-c0a4-4654-8bfc-fc8c34452bf8 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:34.847395 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-d17f1a78-c0a4-4654-8bfc-fc8c34452bf8 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:34.973267 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-d17f1a78-c0a4-4654-8bfc-fc8c34452bf8 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db3cd25f4c94640854677709d10ccbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0e917f30d3430bb088ca3d0afe1a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:34.981106 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-d17f1a78-c0a4-4654-8bfc-fc8c34452bf8 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] 10.222.0.57 "GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d" status: 200 len: 1517 microversion: 2.1 time: 0.153803 Jun 07 09:37:34.981668 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 483/966] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:37:34 2022] GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d => generated 1517 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:37:35.567440 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-b90f7db2-5e94-4afb-a07e-eaf4fa847e14 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:35.568044 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-b90f7db2-5e94-4afb-a07e-eaf4fa847e14 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 3cc1496a-defc-48eb-8e12-4b328dd6fa31] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:35.574411 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b90f7db2-5e94-4afb-a07e-eaf4fa847e14 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:35.574857 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b90f7db2-5e94-4afb-a07e-eaf4fa847e14 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:35.575639 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b90f7db2-5e94-4afb-a07e-eaf4fa847e14 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:35.576072 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b90f7db2-5e94-4afb-a07e-eaf4fa847e14 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:35.704872 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-b90f7db2-5e94-4afb-a07e-eaf4fa847e14 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:35.712624 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-b90f7db2-5e94-4afb-a07e-eaf4fa847e14 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:35.714122 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-b90f7db2-5e94-4afb-a07e-eaf4fa847e14 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:35.715255 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-b90f7db2-5e94-4afb-a07e-eaf4fa847e14 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31" status: 200 len: 1729 microversion: 2.20 time: 0.152176 Jun 07 09:37:35.715815 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 484/967] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:37:35 2022] GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31 => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:37:35.997631 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-1d75777e-667d-4ae1-b981-bfddc4544510 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:35.998239 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-1d75777e-667d-4ae1-b981-bfddc4544510 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] [instance: dd2acb94-efe3-4c28-b597-21b0cfa1f27d] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:36.005491 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-1d75777e-667d-4ae1-b981-bfddc4544510 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:36.005935 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-1d75777e-667d-4ae1-b981-bfddc4544510 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:36.006700 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-1d75777e-667d-4ae1-b981-bfddc4544510 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:36.007137 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-1d75777e-667d-4ae1-b981-bfddc4544510 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:36.139216 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-1d75777e-667d-4ae1-b981-bfddc4544510 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db3cd25f4c94640854677709d10ccbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0e917f30d3430bb088ca3d0afe1a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:36.146883 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-1d75777e-667d-4ae1-b981-bfddc4544510 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] 10.222.0.57 "GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d" status: 200 len: 1517 microversion: 2.1 time: 0.153090 Jun 07 09:37:36.147453 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 484/968] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:37:35 2022] GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d => generated 1517 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:37:36.733226 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-e4f036be-e74c-441b-93c4-6659c4bbf7db tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:36.733866 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-e4f036be-e74c-441b-93c4-6659c4bbf7db tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 3cc1496a-defc-48eb-8e12-4b328dd6fa31] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:36.740369 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-e4f036be-e74c-441b-93c4-6659c4bbf7db tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:36.740909 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-e4f036be-e74c-441b-93c4-6659c4bbf7db tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:36.741656 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-e4f036be-e74c-441b-93c4-6659c4bbf7db tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:36.742091 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-e4f036be-e74c-441b-93c4-6659c4bbf7db tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:36.869877 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-e4f036be-e74c-441b-93c4-6659c4bbf7db tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:36.877703 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-e4f036be-e74c-441b-93c4-6659c4bbf7db tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:36.879208 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-e4f036be-e74c-441b-93c4-6659c4bbf7db tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:36.880349 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-e4f036be-e74c-441b-93c4-6659c4bbf7db tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31" status: 200 len: 1729 microversion: 2.20 time: 0.151004 Jun 07 09:37:36.880944 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 485/969] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:37:36 2022] GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31 => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:37:37.165555 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-f05c8834-06d2-428f-ad92-832bef1c49ed tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:37.166172 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-f05c8834-06d2-428f-ad92-832bef1c49ed tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] [instance: dd2acb94-efe3-4c28-b597-21b0cfa1f27d] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:37.172657 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-f05c8834-06d2-428f-ad92-832bef1c49ed tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:37.173108 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-f05c8834-06d2-428f-ad92-832bef1c49ed tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:37.173869 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-f05c8834-06d2-428f-ad92-832bef1c49ed tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:37.174306 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-f05c8834-06d2-428f-ad92-832bef1c49ed tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:37.304692 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-f05c8834-06d2-428f-ad92-832bef1c49ed tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db3cd25f4c94640854677709d10ccbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0e917f30d3430bb088ca3d0afe1a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:37.312255 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-f05c8834-06d2-428f-ad92-832bef1c49ed tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] 10.222.0.57 "GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d" status: 200 len: 1519 microversion: 2.1 time: 0.150901 Jun 07 09:37:37.312855 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 485/970] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:37:37 2022] GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d => generated 1519 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:37:37.898763 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-e6586b38-dabe-4464-9515-2198e2a411ea tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:37.899353 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-e6586b38-dabe-4464-9515-2198e2a411ea tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 3cc1496a-defc-48eb-8e12-4b328dd6fa31] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:37.905895 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-e6586b38-dabe-4464-9515-2198e2a411ea tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:37.906344 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-e6586b38-dabe-4464-9515-2198e2a411ea tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:37.907094 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-e6586b38-dabe-4464-9515-2198e2a411ea tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:37.907534 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-e6586b38-dabe-4464-9515-2198e2a411ea tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:38.036505 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-e6586b38-dabe-4464-9515-2198e2a411ea tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:38.044541 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-e6586b38-dabe-4464-9515-2198e2a411ea tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:38.046059 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-e6586b38-dabe-4464-9515-2198e2a411ea tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:38.047198 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-e6586b38-dabe-4464-9515-2198e2a411ea tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31" status: 200 len: 1729 microversion: 2.20 time: 0.152425 Jun 07 09:37:38.048258 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 486/971] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:37:37 2022] GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31 => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:37:38.330286 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-68a8774c-41c8-4ae8-b262-5f259a663f85 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:38.330893 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-68a8774c-41c8-4ae8-b262-5f259a663f85 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] [instance: dd2acb94-efe3-4c28-b597-21b0cfa1f27d] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:38.337306 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-68a8774c-41c8-4ae8-b262-5f259a663f85 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:38.337755 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-68a8774c-41c8-4ae8-b262-5f259a663f85 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:38.338509 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-68a8774c-41c8-4ae8-b262-5f259a663f85 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:38.338945 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-68a8774c-41c8-4ae8-b262-5f259a663f85 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:38.468831 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-68a8774c-41c8-4ae8-b262-5f259a663f85 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db3cd25f4c94640854677709d10ccbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0e917f30d3430bb088ca3d0afe1a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:38.476242 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-68a8774c-41c8-4ae8-b262-5f259a663f85 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] 10.222.0.57 "GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d" status: 200 len: 1519 microversion: 2.1 time: 0.150268 Jun 07 09:37:38.477165 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 486/972] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:37:38 2022] GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d => generated 1519 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:37:39.066415 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-7ec2f7e3-c7df-40e5-b8c5-f9aac9eaf06a tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:39.071134 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-7ec2f7e3-c7df-40e5-b8c5-f9aac9eaf06a tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 3cc1496a-defc-48eb-8e12-4b328dd6fa31] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:39.073521 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-7ec2f7e3-c7df-40e5-b8c5-f9aac9eaf06a tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:39.074049 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-7ec2f7e3-c7df-40e5-b8c5-f9aac9eaf06a tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:39.074801 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-7ec2f7e3-c7df-40e5-b8c5-f9aac9eaf06a tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:39.075226 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-7ec2f7e3-c7df-40e5-b8c5-f9aac9eaf06a tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:39.202457 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-7ec2f7e3-c7df-40e5-b8c5-f9aac9eaf06a tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:39.210304 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-7ec2f7e3-c7df-40e5-b8c5-f9aac9eaf06a tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:39.211835 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-7ec2f7e3-c7df-40e5-b8c5-f9aac9eaf06a tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:39.213021 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-7ec2f7e3-c7df-40e5-b8c5-f9aac9eaf06a tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31" status: 200 len: 1729 microversion: 2.20 time: 0.151089 Jun 07 09:37:39.213575 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 487/973] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:37:39 2022] GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31 => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:37:39.493868 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-14d32ef4-4896-4c3a-9db6-7120f7ae6cd9 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:39.494562 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-14d32ef4-4896-4c3a-9db6-7120f7ae6cd9 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] [instance: dd2acb94-efe3-4c28-b597-21b0cfa1f27d] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:39.501058 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-14d32ef4-4896-4c3a-9db6-7120f7ae6cd9 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:39.501508 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-14d32ef4-4896-4c3a-9db6-7120f7ae6cd9 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:39.502372 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-14d32ef4-4896-4c3a-9db6-7120f7ae6cd9 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:39.502806 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-14d32ef4-4896-4c3a-9db6-7120f7ae6cd9 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:39.637031 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-14d32ef4-4896-4c3a-9db6-7120f7ae6cd9 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db3cd25f4c94640854677709d10ccbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0e917f30d3430bb088ca3d0afe1a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:39.645792 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-14d32ef4-4896-4c3a-9db6-7120f7ae6cd9 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] 10.222.0.57 "GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d" status: 200 len: 1519 microversion: 2.1 time: 0.155827 Jun 07 09:37:39.646613 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 487/974] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:37:39 2022] GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:37:40.231873 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-c99020d9-60d7-4089-bda2-1b8f9514da08 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:40.232456 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-c99020d9-60d7-4089-bda2-1b8f9514da08 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 3cc1496a-defc-48eb-8e12-4b328dd6fa31] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:40.238946 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-c99020d9-60d7-4089-bda2-1b8f9514da08 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:40.239399 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-c99020d9-60d7-4089-bda2-1b8f9514da08 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:40.240165 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-c99020d9-60d7-4089-bda2-1b8f9514da08 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:40.240616 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-c99020d9-60d7-4089-bda2-1b8f9514da08 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:40.372694 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-c99020d9-60d7-4089-bda2-1b8f9514da08 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:40.380858 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-c99020d9-60d7-4089-bda2-1b8f9514da08 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:40.382490 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-c99020d9-60d7-4089-bda2-1b8f9514da08 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:40.383637 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-c99020d9-60d7-4089-bda2-1b8f9514da08 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31" status: 200 len: 1729 microversion: 2.20 time: 0.155811 Jun 07 09:37:40.384188 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 488/975] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:37:40 2022] GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:37:40.444127 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-367c16be-43fd-4037-abfb-14a6db374471 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:40.445079 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-367c16be-43fd-4037-abfb-14a6db374471 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 51d3266a-292e-4fce-a594-e8cbda085c6e] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:40.450968 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-367c16be-43fd-4037-abfb-14a6db374471 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:40.452209 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-367c16be-43fd-4037-abfb-14a6db374471 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:40.452209 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-367c16be-43fd-4037-abfb-14a6db374471 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:40.452633 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-367c16be-43fd-4037-abfb-14a6db374471 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:40.482842 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-367c16be-43fd-4037-abfb-14a6db374471 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/51d3266a-292e-4fce-a594-e8cbda085c6e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042697 Jun 07 09:37:40.483318 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 488/976] 10.222.0.57 () {58 vars in 1301 bytes} [Tue Jun 7 09:37:40 2022] GET /compute/v2.1/servers/51d3266a-292e-4fce-a594-e8cbda085c6e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:37:40.623242 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-75fa1d9b-c978-45da-84ff-ccd3f5315120 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:40.623731 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-75fa1d9b-c978-45da-84ff-ccd3f5315120 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 51d3266a-292e-4fce-a594-e8cbda085c6e] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:40.629691 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-75fa1d9b-c978-45da-84ff-ccd3f5315120 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:40.630164 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-75fa1d9b-c978-45da-84ff-ccd3f5315120 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:40.630892 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-75fa1d9b-c978-45da-84ff-ccd3f5315120 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:40.631327 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-75fa1d9b-c978-45da-84ff-ccd3f5315120 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:40.658959 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:37:40.662894 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-75fa1d9b-c978-45da-84ff-ccd3f5315120 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/51d3266a-292e-4fce-a594-e8cbda085c6e/os-volume_attachments/553371e8-3151-40aa-b198-0864b3eaf8d6" status: 200 len: 194 microversion: 2.1 time: 0.043758 Jun 07 09:37:40.663487 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 489/977] 10.222.0.57 () {58 vars in 1412 bytes} [Tue Jun 7 09:37:40 2022] GET /compute/v2.1/servers/51d3266a-292e-4fce-a594-e8cbda085c6e/os-volume_attachments/553371e8-3151-40aa-b198-0864b3eaf8d6 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:37:40.664140 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-9a1f4149-97ea-4fa2-b417-8268cddbf46d tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:40.664834 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-9a1f4149-97ea-4fa2-b417-8268cddbf46d tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] [instance: dd2acb94-efe3-4c28-b597-21b0cfa1f27d] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:40.671452 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-9a1f4149-97ea-4fa2-b417-8268cddbf46d tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:40.671900 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-9a1f4149-97ea-4fa2-b417-8268cddbf46d tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:40.672884 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-33e40443-fbb0-40b2-9733-74c8f547eb9a tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:40.673029 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-9a1f4149-97ea-4fa2-b417-8268cddbf46d tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:40.673131 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-33e40443-fbb0-40b2-9733-74c8f547eb9a tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 51d3266a-292e-4fce-a594-e8cbda085c6e] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:40.673237 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-9a1f4149-97ea-4fa2-b417-8268cddbf46d tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:40.675741 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writing DB stats nova_cell1:SELECT=100 {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:37:40.678741 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-33e40443-fbb0-40b2-9733-74c8f547eb9a tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:40.681270 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-33e40443-fbb0-40b2-9733-74c8f547eb9a tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:40.681270 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-33e40443-fbb0-40b2-9733-74c8f547eb9a tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:40.681270 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-33e40443-fbb0-40b2-9733-74c8f547eb9a tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:40.765822 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.objects.instance [None req-33e40443-fbb0-40b2-9733-74c8f547eb9a tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lazy-loading 'services' on Instance uuid 51d3266a-292e-4fce-a594-e8cbda085c6e {{(pid=118741) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 09:37:40.819294 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-9a1f4149-97ea-4fa2-b417-8268cddbf46d tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db3cd25f4c94640854677709d10ccbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0e917f30d3430bb088ca3d0afe1a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:40.827121 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-9a1f4149-97ea-4fa2-b417-8268cddbf46d tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] 10.222.0.57 "GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d" status: 200 len: 1519 microversion: 2.1 time: 0.166961 Jun 07 09:37:40.827692 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 489/978] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:37:40 2022] GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d => generated 1519 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:37:40.998969 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-33e40443-fbb0-40b2-9733-74c8f547eb9a tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "DELETE /compute/v2.1/servers/51d3266a-292e-4fce-a594-e8cbda085c6e/os-volume_attachments/553371e8-3151-40aa-b198-0864b3eaf8d6" status: 202 len: 0 microversion: 2.1 time: 0.329774 Jun 07 09:37:40.999635 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 490/979] 10.222.0.57 () {58 vars in 1415 bytes} [Tue Jun 7 09:37:40 2022] DELETE /compute/v2.1/servers/51d3266a-292e-4fce-a594-e8cbda085c6e/os-volume_attachments/553371e8-3151-40aa-b198-0864b3eaf8d6 => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 07 09:37:41.402375 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-15e2a2bb-5cea-4c35-bc34-da2b886a0827 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:41.402984 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-15e2a2bb-5cea-4c35-bc34-da2b886a0827 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 3cc1496a-defc-48eb-8e12-4b328dd6fa31] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:41.409832 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-15e2a2bb-5cea-4c35-bc34-da2b886a0827 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:41.410350 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-15e2a2bb-5cea-4c35-bc34-da2b886a0827 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:41.413420 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-15e2a2bb-5cea-4c35-bc34-da2b886a0827 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:41.413420 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-15e2a2bb-5cea-4c35-bc34-da2b886a0827 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:41.537451 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-15e2a2bb-5cea-4c35-bc34-da2b886a0827 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:41.545291 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-15e2a2bb-5cea-4c35-bc34-da2b886a0827 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:41.546829 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-15e2a2bb-5cea-4c35-bc34-da2b886a0827 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:41.547978 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-15e2a2bb-5cea-4c35-bc34-da2b886a0827 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31" status: 200 len: 1729 microversion: 2.20 time: 0.149554 Jun 07 09:37:41.548535 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 490/980] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:37:41 2022] GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31 => generated 1729 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:37:41.846336 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-787901b0-3718-444e-b8a4-21dd08c41a40 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:41.846957 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-787901b0-3718-444e-b8a4-21dd08c41a40 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] [instance: dd2acb94-efe3-4c28-b597-21b0cfa1f27d] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:41.854104 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-787901b0-3718-444e-b8a4-21dd08c41a40 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:41.854558 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-787901b0-3718-444e-b8a4-21dd08c41a40 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:41.855318 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-787901b0-3718-444e-b8a4-21dd08c41a40 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:41.855757 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-787901b0-3718-444e-b8a4-21dd08c41a40 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:41.985958 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-787901b0-3718-444e-b8a4-21dd08c41a40 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db3cd25f4c94640854677709d10ccbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0e917f30d3430bb088ca3d0afe1a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:41.993395 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-787901b0-3718-444e-b8a4-21dd08c41a40 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] 10.222.0.57 "GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d" status: 200 len: 1575 microversion: 2.1 time: 0.151927 Jun 07 09:37:41.993959 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 491/981] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:37:41 2022] GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:37:42.565764 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-2e2ad4d2-6439-4556-a0c9-1b5f74a00dfd tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:42.566481 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-2e2ad4d2-6439-4556-a0c9-1b5f74a00dfd tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 3cc1496a-defc-48eb-8e12-4b328dd6fa31] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:42.573342 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-2e2ad4d2-6439-4556-a0c9-1b5f74a00dfd tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:42.573881 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-2e2ad4d2-6439-4556-a0c9-1b5f74a00dfd tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:42.574718 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-2e2ad4d2-6439-4556-a0c9-1b5f74a00dfd tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:42.575232 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-2e2ad4d2-6439-4556-a0c9-1b5f74a00dfd tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:42.716941 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-2e2ad4d2-6439-4556-a0c9-1b5f74a00dfd tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:42.722906 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-2e2ad4d2-6439-4556-a0c9-1b5f74a00dfd tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:42.724410 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-2e2ad4d2-6439-4556-a0c9-1b5f74a00dfd tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:42.725626 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-2e2ad4d2-6439-4556-a0c9-1b5f74a00dfd tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31" status: 200 len: 1729 microversion: 2.20 time: 0.163882 Jun 07 09:37:42.726197 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 491/982] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:37:42 2022] GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31 => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:37:43.011469 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-86e948a0-799d-4b68-8342-543ba874aabe tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:43.012109 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-86e948a0-799d-4b68-8342-543ba874aabe tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] [instance: dd2acb94-efe3-4c28-b597-21b0cfa1f27d] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:43.020274 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-86e948a0-799d-4b68-8342-543ba874aabe tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:43.020974 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-86e948a0-799d-4b68-8342-543ba874aabe tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:43.022255 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-86e948a0-799d-4b68-8342-543ba874aabe tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:43.022885 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-86e948a0-799d-4b68-8342-543ba874aabe tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:43.024962 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [req-bbd0aaed-65e4-403b-8cbc-b593d5c86e1a req-e3bbd0c7-303d-4a1f-96af-a65067d26c53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cc1496a-defc-48eb-8e12-4b328dd6fa31", "name": "network-vif-plugged", "status": "completed", "tag": "f987791d-1369-4164-867a-29c6d0558f0c"}]} {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:37:43.033751 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [req-bbd0aaed-65e4-403b-8cbc-b593d5c86e1a req-e3bbd0c7-303d-4a1f-96af-a65067d26c53 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:43.034202 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [req-bbd0aaed-65e4-403b-8cbc-b593d5c86e1a req-e3bbd0c7-303d-4a1f-96af-a65067d26c53 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:43.044998 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.compute.server_external_events [req-bbd0aaed-65e4-403b-8cbc-b593d5c86e1a req-e3bbd0c7-303d-4a1f-96af-a65067d26c53 service nova] Creating event network-vif-plugged:f987791d-1369-4164-867a-29c6d0558f0c for instance 3cc1496a-defc-48eb-8e12-4b328dd6fa31 on hv-cinder-83699 Jun 07 09:37:43.050662 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [req-bbd0aaed-65e4-403b-8cbc-b593d5c86e1a req-e3bbd0c7-303d-4a1f-96af-a65067d26c53 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030219 Jun 07 09:37:43.051246 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 492/983] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Jun 7 09:37:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:37:43.159235 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-86e948a0-799d-4b68-8342-543ba874aabe tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db3cd25f4c94640854677709d10ccbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0e917f30d3430bb088ca3d0afe1a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:43.166697 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-86e948a0-799d-4b68-8342-543ba874aabe tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] 10.222.0.57 "GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d" status: 200 len: 1575 microversion: 2.1 time: 0.159324 Jun 07 09:37:43.167268 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 492/984] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:37:43 2022] GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:37:43.185381 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-d389fa0d-1967-4838-9d0f-0ce4c21783ca tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:43.186000 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-d389fa0d-1967-4838-9d0f-0ce4c21783ca tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 51d3266a-292e-4fce-a594-e8cbda085c6e] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:43.192306 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-d389fa0d-1967-4838-9d0f-0ce4c21783ca tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:43.192799 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-d389fa0d-1967-4838-9d0f-0ce4c21783ca tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:43.193570 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-d389fa0d-1967-4838-9d0f-0ce4c21783ca tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:43.194016 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-d389fa0d-1967-4838-9d0f-0ce4c21783ca tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:43.223783 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-d389fa0d-1967-4838-9d0f-0ce4c21783ca tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/51d3266a-292e-4fce-a594-e8cbda085c6e/os-volume_attachments/a58974f0-cfd1-4605-badf-42702b1d39fa" status: 200 len: 194 microversion: 2.1 time: 0.042812 Jun 07 09:37:43.224360 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 493/985] 10.222.0.57 () {58 vars in 1412 bytes} [Tue Jun 7 09:37:43 2022] GET /compute/v2.1/servers/51d3266a-292e-4fce-a594-e8cbda085c6e/os-volume_attachments/a58974f0-cfd1-4605-badf-42702b1d39fa => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:37:43.234160 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-7002f9c3-9bc8-4db2-9add-ab17c2d9456e tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:43.234659 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-7002f9c3-9bc8-4db2-9add-ab17c2d9456e tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 51d3266a-292e-4fce-a594-e8cbda085c6e] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:43.241858 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-7002f9c3-9bc8-4db2-9add-ab17c2d9456e tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:43.242306 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-7002f9c3-9bc8-4db2-9add-ab17c2d9456e tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:43.243058 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-7002f9c3-9bc8-4db2-9add-ab17c2d9456e tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:43.243494 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-7002f9c3-9bc8-4db2-9add-ab17c2d9456e tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:43.321602 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.objects.instance [None req-7002f9c3-9bc8-4db2-9add-ab17c2d9456e tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lazy-loading 'services' on Instance uuid 51d3266a-292e-4fce-a594-e8cbda085c6e {{(pid=118741) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 09:37:43.511869 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-7002f9c3-9bc8-4db2-9add-ab17c2d9456e tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "DELETE /compute/v2.1/servers/51d3266a-292e-4fce-a594-e8cbda085c6e/os-volume_attachments/a58974f0-cfd1-4605-badf-42702b1d39fa" status: 202 len: 0 microversion: 2.1 time: 0.281387 Jun 07 09:37:43.512457 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 493/986] 10.222.0.57 () {58 vars in 1415 bytes} [Tue Jun 7 09:37:43 2022] DELETE /compute/v2.1/servers/51d3266a-292e-4fce-a594-e8cbda085c6e/os-volume_attachments/a58974f0-cfd1-4605-badf-42702b1d39fa => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 09:37:43.745200 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-253b295b-7995-4714-a9fa-b0fbd2c8ecae tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:43.745767 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-253b295b-7995-4714-a9fa-b0fbd2c8ecae tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 3cc1496a-defc-48eb-8e12-4b328dd6fa31] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:43.752737 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-253b295b-7995-4714-a9fa-b0fbd2c8ecae tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:43.753184 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-253b295b-7995-4714-a9fa-b0fbd2c8ecae tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:43.754764 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-253b295b-7995-4714-a9fa-b0fbd2c8ecae tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:43.755382 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-253b295b-7995-4714-a9fa-b0fbd2c8ecae tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:43.890417 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-253b295b-7995-4714-a9fa-b0fbd2c8ecae tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:43.900458 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-253b295b-7995-4714-a9fa-b0fbd2c8ecae tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:43.902212 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-253b295b-7995-4714-a9fa-b0fbd2c8ecae tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:43.903408 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-253b295b-7995-4714-a9fa-b0fbd2c8ecae tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31" status: 200 len: 1729 microversion: 2.20 time: 0.162253 Jun 07 09:37:43.903960 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 494/987] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:37:43 2022] GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:37:44.185793 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-ae7c1d00-67d3-4a18-852b-65f47ba297b1 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:44.186491 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-ae7c1d00-67d3-4a18-852b-65f47ba297b1 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] [instance: dd2acb94-efe3-4c28-b597-21b0cfa1f27d] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:44.193328 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-ae7c1d00-67d3-4a18-852b-65f47ba297b1 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:44.193776 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-ae7c1d00-67d3-4a18-852b-65f47ba297b1 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:44.194574 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-ae7c1d00-67d3-4a18-852b-65f47ba297b1 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:44.194994 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-ae7c1d00-67d3-4a18-852b-65f47ba297b1 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:44.330451 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-ae7c1d00-67d3-4a18-852b-65f47ba297b1 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db3cd25f4c94640854677709d10ccbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0e917f30d3430bb088ca3d0afe1a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:44.340619 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-ae7c1d00-67d3-4a18-852b-65f47ba297b1 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] 10.222.0.57 "GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d" status: 200 len: 1575 microversion: 2.1 time: 0.156936 Jun 07 09:37:44.340619 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 494/988] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:37:44 2022] GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:37:44.921519 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-7ee67b47-2aff-46b3-b410-bd9616c85e36 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:44.922133 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-7ee67b47-2aff-46b3-b410-bd9616c85e36 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 3cc1496a-defc-48eb-8e12-4b328dd6fa31] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:44.925101 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writing DB stats nova_api:SELECT=62 {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:37:44.929817 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-7ee67b47-2aff-46b3-b410-bd9616c85e36 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:44.930268 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-7ee67b47-2aff-46b3-b410-bd9616c85e36 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:44.931036 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-7ee67b47-2aff-46b3-b410-bd9616c85e36 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:44.931474 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-7ee67b47-2aff-46b3-b410-bd9616c85e36 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:45.060525 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-7ee67b47-2aff-46b3-b410-bd9616c85e36 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:45.069409 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-7ee67b47-2aff-46b3-b410-bd9616c85e36 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:45.070903 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-7ee67b47-2aff-46b3-b410-bd9616c85e36 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:45.072122 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-7ee67b47-2aff-46b3-b410-bd9616c85e36 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31" status: 200 len: 1729 microversion: 2.20 time: 0.154589 Jun 07 09:37:45.076970 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 495/989] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:37:44 2022] GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:37:45.355430 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-d4325f53-b4b6-4984-977c-3682260d247c tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:45.355951 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-d4325f53-b4b6-4984-977c-3682260d247c tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] [instance: dd2acb94-efe3-4c28-b597-21b0cfa1f27d] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:45.362412 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-d4325f53-b4b6-4984-977c-3682260d247c tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:45.362884 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-d4325f53-b4b6-4984-977c-3682260d247c tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:45.363625 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-d4325f53-b4b6-4984-977c-3682260d247c tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:45.364063 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-d4325f53-b4b6-4984-977c-3682260d247c tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:45.493748 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-d4325f53-b4b6-4984-977c-3682260d247c tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db3cd25f4c94640854677709d10ccbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0e917f30d3430bb088ca3d0afe1a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:45.501927 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-d4325f53-b4b6-4984-977c-3682260d247c tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] 10.222.0.57 "GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d" status: 200 len: 1575 microversion: 2.1 time: 0.150627 Jun 07 09:37:45.502497 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 495/990] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:37:45 2022] GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:37:45.716489 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-ebe5cc42-3009-447a-a629-56c2e7452aaf tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:45.717497 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-ebe5cc42-3009-447a-a629-56c2e7452aaf tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 51d3266a-292e-4fce-a594-e8cbda085c6e] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:45.724058 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-ebe5cc42-3009-447a-a629-56c2e7452aaf tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:45.724532 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-ebe5cc42-3009-447a-a629-56c2e7452aaf tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:45.725336 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-ebe5cc42-3009-447a-a629-56c2e7452aaf tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:45.725772 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-ebe5cc42-3009-447a-a629-56c2e7452aaf tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:45.753741 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-ebe5cc42-3009-447a-a629-56c2e7452aaf tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/51d3266a-292e-4fce-a594-e8cbda085c6e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041173 Jun 07 09:37:45.754265 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 496/991] 10.222.0.57 () {58 vars in 1301 bytes} [Tue Jun 7 09:37:45 2022] GET /compute/v2.1/servers/51d3266a-292e-4fce-a594-e8cbda085c6e/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 07 09:37:45.855476 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-367be4d8-3590-4e9c-8524-0d2b7eb8db4c tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:45.856457 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-367be4d8-3590-4e9c-8524-0d2b7eb8db4c tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 51d3266a-292e-4fce-a594-e8cbda085c6e] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:45.862978 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-367be4d8-3590-4e9c-8524-0d2b7eb8db4c tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:45.863432 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-367be4d8-3590-4e9c-8524-0d2b7eb8db4c tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:45.864194 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-367be4d8-3590-4e9c-8524-0d2b7eb8db4c tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:45.864659 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-367be4d8-3590-4e9c-8524-0d2b7eb8db4c tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:46.043604 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-367be4d8-3590-4e9c-8524-0d2b7eb8db4c tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/51d3266a-292e-4fce-a594-e8cbda085c6e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.192220 Jun 07 09:37:46.044152 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 496/992] 10.222.0.57 () {58 vars in 1301 bytes} [Tue Jun 7 09:37:45 2022] GET /compute/v2.1/servers/51d3266a-292e-4fce-a594-e8cbda085c6e/os-volume_attachments => generated 25 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 07 09:37:46.090396 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-925664e0-a740-4116-81ea-b238ae9830b1 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:46.091013 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-925664e0-a740-4116-81ea-b238ae9830b1 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 3cc1496a-defc-48eb-8e12-4b328dd6fa31] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:46.098248 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-925664e0-a740-4116-81ea-b238ae9830b1 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:46.098708 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-925664e0-a740-4116-81ea-b238ae9830b1 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:46.099477 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-925664e0-a740-4116-81ea-b238ae9830b1 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:46.099619 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-c04f06d3-99fc-4f9b-8770-b5bf2652adf7 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:46.099915 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-925664e0-a740-4116-81ea-b238ae9830b1 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:46.100121 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-c04f06d3-99fc-4f9b-8770-b5bf2652adf7 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 51d3266a-292e-4fce-a594-e8cbda085c6e] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:46.106382 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-c04f06d3-99fc-4f9b-8770-b5bf2652adf7 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:46.106834 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-c04f06d3-99fc-4f9b-8770-b5bf2652adf7 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:46.107594 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-c04f06d3-99fc-4f9b-8770-b5bf2652adf7 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:46.108035 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-c04f06d3-99fc-4f9b-8770-b5bf2652adf7 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:46.134535 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-c04f06d3-99fc-4f9b-8770-b5bf2652adf7 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 51d3266a-292e-4fce-a594-e8cbda085c6e] Going to try to terminate instance {{(pid=118741) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 09:37:46.233374 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-925664e0-a740-4116-81ea-b238ae9830b1 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:46.241213 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-925664e0-a740-4116-81ea-b238ae9830b1 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:46.242799 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-925664e0-a740-4116-81ea-b238ae9830b1 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:46.243960 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-925664e0-a740-4116-81ea-b238ae9830b1 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31" status: 200 len: 1729 microversion: 2.20 time: 0.157501 Jun 07 09:37:46.244522 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 497/993] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:37:46 2022] GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:37:46.352886 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-c04f06d3-99fc-4f9b-8770-b5bf2652adf7 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "DELETE /compute/v2.1/servers/51d3266a-292e-4fce-a594-e8cbda085c6e" status: 204 len: 0 microversion: 2.1 time: 0.256761 Jun 07 09:37:46.353493 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 497/994] 10.222.0.57 () {58 vars in 1238 bytes} [Tue Jun 7 09:37:46 2022] DELETE /compute/v2.1/servers/51d3266a-292e-4fce-a594-e8cbda085c6e => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 07 09:37:46.362025 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-d401c130-86b1-47e6-a898-e2f0e64e0a5d tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:46.362640 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-d401c130-86b1-47e6-a898-e2f0e64e0a5d tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 51d3266a-292e-4fce-a594-e8cbda085c6e] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:46.368820 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-d401c130-86b1-47e6-a898-e2f0e64e0a5d tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:46.369280 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-d401c130-86b1-47e6-a898-e2f0e64e0a5d tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:46.370056 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-d401c130-86b1-47e6-a898-e2f0e64e0a5d tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:46.370500 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-d401c130-86b1-47e6-a898-e2f0e64e0a5d tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:46.507273 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-d401c130-86b1-47e6-a898-e2f0e64e0a5d tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0346f4e3855142059983083e71c2c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c21b1cbbd604d6d9c97ab7c3c788f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:46.515254 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-d401c130-86b1-47e6-a898-e2f0e64e0a5d tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/51d3266a-292e-4fce-a594-e8cbda085c6e" status: 200 len: 1674 microversion: 2.1 time: 0.157542 Jun 07 09:37:46.515972 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 498/995] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:37:46 2022] GET /compute/v2.1/servers/51d3266a-292e-4fce-a594-e8cbda085c6e => generated 1674 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:37:46.520941 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-59b3fabd-8423-4b95-83a9-c9b0ac978c4f tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:46.521763 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-59b3fabd-8423-4b95-83a9-c9b0ac978c4f tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] [instance: dd2acb94-efe3-4c28-b597-21b0cfa1f27d] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:46.528220 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-59b3fabd-8423-4b95-83a9-c9b0ac978c4f tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:46.532568 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-59b3fabd-8423-4b95-83a9-c9b0ac978c4f tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:46.532568 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-59b3fabd-8423-4b95-83a9-c9b0ac978c4f tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:46.532568 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-59b3fabd-8423-4b95-83a9-c9b0ac978c4f tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:46.665730 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-59b3fabd-8423-4b95-83a9-c9b0ac978c4f tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db3cd25f4c94640854677709d10ccbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0e917f30d3430bb088ca3d0afe1a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:46.673358 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-59b3fabd-8423-4b95-83a9-c9b0ac978c4f tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] 10.222.0.57 "GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d" status: 200 len: 1575 microversion: 2.1 time: 0.157674 Jun 07 09:37:46.673908 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 498/996] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:37:46 2022] GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:37:47.262465 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-3c55b749-00fc-49a3-9fbd-aaf06a46bd02 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:47.263113 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-3c55b749-00fc-49a3-9fbd-aaf06a46bd02 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 3cc1496a-defc-48eb-8e12-4b328dd6fa31] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:47.270103 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-3c55b749-00fc-49a3-9fbd-aaf06a46bd02 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:47.270557 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-3c55b749-00fc-49a3-9fbd-aaf06a46bd02 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:47.271319 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-3c55b749-00fc-49a3-9fbd-aaf06a46bd02 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:47.271756 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-3c55b749-00fc-49a3-9fbd-aaf06a46bd02 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:47.403755 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-3c55b749-00fc-49a3-9fbd-aaf06a46bd02 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:47.412498 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-3c55b749-00fc-49a3-9fbd-aaf06a46bd02 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:47.414188 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-3c55b749-00fc-49a3-9fbd-aaf06a46bd02 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:47.415352 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-3c55b749-00fc-49a3-9fbd-aaf06a46bd02 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31" status: 200 len: 1729 microversion: 2.20 time: 0.156826 Jun 07 09:37:47.416106 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 499/997] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:37:47 2022] GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31 => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:37:47.532545 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-770f0c1b-582a-4435-b611-335e38648cf8 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:47.533215 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-770f0c1b-582a-4435-b611-335e38648cf8 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 51d3266a-292e-4fce-a594-e8cbda085c6e] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:47.539616 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-770f0c1b-582a-4435-b611-335e38648cf8 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:47.540070 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-770f0c1b-582a-4435-b611-335e38648cf8 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:47.540861 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-770f0c1b-582a-4435-b611-335e38648cf8 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:47.541308 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-770f0c1b-582a-4435-b611-335e38648cf8 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:47.667942 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-770f0c1b-582a-4435-b611-335e38648cf8 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0346f4e3855142059983083e71c2c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c21b1cbbd604d6d9c97ab7c3c788f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:47.675281 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-770f0c1b-582a-4435-b611-335e38648cf8 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/51d3266a-292e-4fce-a594-e8cbda085c6e" status: 200 len: 1674 microversion: 2.1 time: 0.146698 Jun 07 09:37:47.675835 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 499/998] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:37:47 2022] GET /compute/v2.1/servers/51d3266a-292e-4fce-a594-e8cbda085c6e => generated 1674 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:37:47.690864 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-1356610d-08d9-4db2-88e7-2f128bb17d2e tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:47.691482 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-1356610d-08d9-4db2-88e7-2f128bb17d2e tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] [instance: dd2acb94-efe3-4c28-b597-21b0cfa1f27d] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:47.697509 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-1356610d-08d9-4db2-88e7-2f128bb17d2e tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:47.697962 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-1356610d-08d9-4db2-88e7-2f128bb17d2e tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:47.698724 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-1356610d-08d9-4db2-88e7-2f128bb17d2e tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:47.699162 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-1356610d-08d9-4db2-88e7-2f128bb17d2e tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:47.825081 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-1356610d-08d9-4db2-88e7-2f128bb17d2e tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db3cd25f4c94640854677709d10ccbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0e917f30d3430bb088ca3d0afe1a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:47.832709 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-1356610d-08d9-4db2-88e7-2f128bb17d2e tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] 10.222.0.57 "GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d" status: 200 len: 1575 microversion: 2.1 time: 0.146162 Jun 07 09:37:47.833267 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 500/999] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:37:47 2022] GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d => generated 1575 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:37:48.433459 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-237e33a1-5088-46fb-bb9c-08906c92a32f tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:48.434062 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-237e33a1-5088-46fb-bb9c-08906c92a32f tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 3cc1496a-defc-48eb-8e12-4b328dd6fa31] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:48.440161 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-237e33a1-5088-46fb-bb9c-08906c92a32f tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:48.440628 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-237e33a1-5088-46fb-bb9c-08906c92a32f tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:48.441386 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-237e33a1-5088-46fb-bb9c-08906c92a32f tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:48.441822 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-237e33a1-5088-46fb-bb9c-08906c92a32f tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:48.569922 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-237e33a1-5088-46fb-bb9c-08906c92a32f tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:48.578003 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-237e33a1-5088-46fb-bb9c-08906c92a32f tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:48.579979 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-237e33a1-5088-46fb-bb9c-08906c92a32f tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:48.581164 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-237e33a1-5088-46fb-bb9c-08906c92a32f tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31" status: 200 len: 1716 microversion: 2.20 time: 0.151679 Jun 07 09:37:48.581708 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 500/1000] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:37:48 2022] GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31 => generated 1716 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:37:48.691598 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-1f39ca24-6d45-4208-83c7-35c2c89e20bd tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:48.692211 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-1f39ca24-6d45-4208-83c7-35c2c89e20bd tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 51d3266a-292e-4fce-a594-e8cbda085c6e] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:48.698630 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-1f39ca24-6d45-4208-83c7-35c2c89e20bd tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:48.699082 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-1f39ca24-6d45-4208-83c7-35c2c89e20bd tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:48.699848 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-1f39ca24-6d45-4208-83c7-35c2c89e20bd tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:48.700286 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-1f39ca24-6d45-4208-83c7-35c2c89e20bd tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:48.829652 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-1f39ca24-6d45-4208-83c7-35c2c89e20bd tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0346f4e3855142059983083e71c2c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c21b1cbbd604d6d9c97ab7c3c788f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:48.837282 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-1f39ca24-6d45-4208-83c7-35c2c89e20bd tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/51d3266a-292e-4fce-a594-e8cbda085c6e" status: 200 len: 1674 microversion: 2.1 time: 0.149610 Jun 07 09:37:48.838045 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 501/1001] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:37:48 2022] GET /compute/v2.1/servers/51d3266a-292e-4fce-a594-e8cbda085c6e => generated 1674 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:37:48.850854 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-931021b9-a01a-4545-9da5-285afb20f194 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:48.851774 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-931021b9-a01a-4545-9da5-285afb20f194 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] [instance: dd2acb94-efe3-4c28-b597-21b0cfa1f27d] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:48.857673 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-931021b9-a01a-4545-9da5-285afb20f194 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:48.858113 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-931021b9-a01a-4545-9da5-285afb20f194 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:48.858866 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-931021b9-a01a-4545-9da5-285afb20f194 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:48.859291 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-931021b9-a01a-4545-9da5-285afb20f194 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:49.110921 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-931021b9-a01a-4545-9da5-285afb20f194 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db3cd25f4c94640854677709d10ccbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0e917f30d3430bb088ca3d0afe1a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:49.120413 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-931021b9-a01a-4545-9da5-285afb20f194 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] 10.222.0.57 "GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d" status: 200 len: 1575 microversion: 2.1 time: 0.273382 Jun 07 09:37:49.122117 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 501/1002] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:37:48 2022] GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d => generated 1575 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:37:49.591187 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [req-cbfdfa03-4150-4229-8c71-150981b60f54 req-3a001129-2645-4ee0-ae0e-d2a63a4d89c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51d3266a-292e-4fce-a594-e8cbda085c6e", "name": "network-vif-deleted", "tag": "4ab4124b-15f7-4f01-8f32-ed6e3aaf3c7a"}]} {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:37:49.599276 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [req-cbfdfa03-4150-4229-8c71-150981b60f54 req-3a001129-2645-4ee0-ae0e-d2a63a4d89c3 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:49.599723 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [req-cbfdfa03-4150-4229-8c71-150981b60f54 req-3a001129-2645-4ee0-ae0e-d2a63a4d89c3 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:49.611484 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.compute.server_external_events [req-cbfdfa03-4150-4229-8c71-150981b60f54 req-3a001129-2645-4ee0-ae0e-d2a63a4d89c3 service nova] Creating event network-vif-deleted:4ab4124b-15f7-4f01-8f32-ed6e3aaf3c7a for instance 51d3266a-292e-4fce-a594-e8cbda085c6e on hv-cinder-83699 Jun 07 09:37:49.616667 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [req-cbfdfa03-4150-4229-8c71-150981b60f54 req-3a001129-2645-4ee0-ae0e-d2a63a4d89c3 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029143 Jun 07 09:37:49.617444 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 502/1003] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Jun 7 09:37:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:37:49.855510 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-7d7e6c73-4f72-43a3-9932-cc0cbb6a7ac3 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:49.856206 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-7d7e6c73-4f72-43a3-9932-cc0cbb6a7ac3 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 51d3266a-292e-4fce-a594-e8cbda085c6e] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:49.863643 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-7d7e6c73-4f72-43a3-9932-cc0cbb6a7ac3 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:49.864186 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-7d7e6c73-4f72-43a3-9932-cc0cbb6a7ac3 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:49.865082 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-7d7e6c73-4f72-43a3-9932-cc0cbb6a7ac3 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:49.865584 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-7d7e6c73-4f72-43a3-9932-cc0cbb6a7ac3 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:49.929661 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-7d7e6c73-4f72-43a3-9932-cc0cbb6a7ac3 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0346f4e3855142059983083e71c2c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c21b1cbbd604d6d9c97ab7c3c788f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:49.937524 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-7d7e6c73-4f72-43a3-9932-cc0cbb6a7ac3 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/51d3266a-292e-4fce-a594-e8cbda085c6e" status: 200 len: 1606 microversion: 2.1 time: 0.086163 Jun 07 09:37:49.938094 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 502/1004] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:37:49 2022] GET /compute/v2.1/servers/51d3266a-292e-4fce-a594-e8cbda085c6e => generated 1606 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:37:50.139805 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-0ac3df30-1cc3-44a3-be62-8c732e2ac2ab tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:50.140536 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-0ac3df30-1cc3-44a3-be62-8c732e2ac2ab tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] [instance: dd2acb94-efe3-4c28-b597-21b0cfa1f27d] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:50.147491 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-0ac3df30-1cc3-44a3-be62-8c732e2ac2ab tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:50.147941 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-0ac3df30-1cc3-44a3-be62-8c732e2ac2ab tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:50.148747 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-0ac3df30-1cc3-44a3-be62-8c732e2ac2ab tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:50.149188 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-0ac3df30-1cc3-44a3-be62-8c732e2ac2ab tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:50.289335 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-0ac3df30-1cc3-44a3-be62-8c732e2ac2ab tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db3cd25f4c94640854677709d10ccbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0e917f30d3430bb088ca3d0afe1a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:50.297347 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-0ac3df30-1cc3-44a3-be62-8c732e2ac2ab tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] 10.222.0.57 "GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d" status: 200 len: 1575 microversion: 2.1 time: 0.162652 Jun 07 09:37:50.297959 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 503/1005] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:37:50 2022] GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d => generated 1575 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:37:50.954668 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-5ecfe556-b2e4-4be0-b3a2-50c4b6721161 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:50.955276 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-5ecfe556-b2e4-4be0-b3a2-50c4b6721161 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 51d3266a-292e-4fce-a594-e8cbda085c6e] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:50.961836 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-5ecfe556-b2e4-4be0-b3a2-50c4b6721161 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:50.964275 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-5ecfe556-b2e4-4be0-b3a2-50c4b6721161 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:50.964275 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-5ecfe556-b2e4-4be0-b3a2-50c4b6721161 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:50.964275 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-5ecfe556-b2e4-4be0-b3a2-50c4b6721161 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:50.977242 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.wsgi [None req-5ecfe556-b2e4-4be0-b3a2-50c4b6721161 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] HTTP exception thrown: Instance 51d3266a-292e-4fce-a594-e8cbda085c6e could not be found. Jun 07 09:37:50.978903 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-5ecfe556-b2e4-4be0-b3a2-50c4b6721161 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Request method failure captured: Jun 07 09:37:50.978903 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: request: GET /compute/v2.1/servers/51d3266a-292e-4fce-a594-e8cbda085c6e HTTP/1.1 Jun 07 09:37:50.978903 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Accept: application/json Jun 07 09:37:50.978903 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Accept-Encoding: identity Jun 07 09:37:50.978903 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Connection: close Jun 07 09:37:50.978903 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Content-Length: 0 Jun 07 09:37:50.978903 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Content-Type: application/json Jun 07 09:37:50.978903 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Host: 10.222.0.57 Jun 07 09:37:50.978903 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Openstack-System-Scope: None Jun 07 09:37:50.978903 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: User-Agent: python-urllib3/1.26.9 Jun 07 09:37:50.978903 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Auth-Token: gAAAAABinxo-GawitE_ljpo8B3KPmM3zA3tdmInFKZArRihdFF0HX1G_wnI2oEs2A5OOMQzXUhFYEU3gmYemELsFy4IB2D5fZhyTXLoqx77Bd6giA_LvjMizTHW06nxTaYAdAHd4mxE0GXaJWwbxbkTRGlHLHeGTFfVba_ZXV9BP3j69OQIBYg8 Jun 07 09:37:50.978903 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Domain-Id: None Jun 07 09:37:50.978903 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Domain-Name: None Jun 07 09:37:50.978903 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Identity-Status: Confirmed Jun 07 09:37:50.978903 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Is-Admin-Project: True Jun 07 09:37:50.978903 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Project-Domain-Id: default Jun 07 09:37:50.978903 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Project-Domain-Name: Default Jun 07 09:37:50.978903 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Project-Id: 1c21b1cbbd604d6d9c97ab7c3c788f3d Jun 07 09:37:50.978903 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Project-Name: tempest-AttachVolumeTestJSON-1184144367 Jun 07 09:37:50.978903 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Role: reader,member Jun 07 09:37:50.978903 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Roles: reader,member Jun 07 09:37:50.980469 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1c21b1cbbd604d6d9c97ab7c3c788f3d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1c21b1cbbd604d6d9c97ab7c3c788f3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1c21b1cbbd604d6d9c97ab7c3c788f3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1c21b1cbbd604d6d9c97ab7c3c788f3d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 07 09:37:50.980469 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Tenant: tempest-AttachVolumeTestJSON-1184144367 Jun 07 09:37:50.980469 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Tenant-Id: 1c21b1cbbd604d6d9c97ab7c3c788f3d Jun 07 09:37:50.980469 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1184144367 Jun 07 09:37:50.980469 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User: tempest-AttachVolumeTestJSON-1184144367-project Jun 07 09:37:50.980469 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User-Domain-Id: default Jun 07 09:37:50.980469 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User-Domain-Name: Default Jun 07 09:37:50.980469 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User-Id: 0346f4e3855142059983083e71c2c0c3 Jun 07 09:37:50.980469 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User-Name: tempest-AttachVolumeTestJSON-1184144367-project Jun 07 09:37:50.980469 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: method: > Jun 07 09:37:50.980469 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: exception: Instance 51d3266a-292e-4fce-a594-e8cbda085c6e could not be found. Jun 07 09:37:50.980469 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: action_args: {'id': '51d3266a-292e-4fce-a594-e8cbda085c6e'} Jun 07 09:37:50.986896 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 09:37:50.986896 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:37:50.986896 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 09:37:50.986896 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 09:37:50.986896 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 09:37:50.986896 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 09:37:50.986896 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 09:37:50.986896 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 09:37:50.986896 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 09:37:50.986896 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 09:37:50.986896 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51d3266a-292e-4fce-a594-e8cbda085c6e could not be found. Jun 07 09:37:50.986896 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:37:50.986896 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:37:50.986896 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:37:50.986896 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:37:50.986896 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:37:50.986896 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:37:50.986896 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 09:37:50.986896 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 09:37:50.986896 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 09:37:50.988358 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 09:37:50.988358 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 09:37:50.988358 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 09:37:50.988358 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 09:37:50.988358 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 09:37:50.988358 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 09:37:50.988358 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 09:37:50.988358 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51d3266a-292e-4fce-a594-e8cbda085c6e could not be found. Jun 07 09:37:50.988358 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:37:50.988358 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:37:50.988358 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:37:50.988358 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:37:50.988358 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:37:50.988358 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:37:50.988358 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 09:37:50.988358 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 09:37:50.988358 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51d3266a-292e-4fce-a594-e8cbda085c6e could not be found. Jun 07 09:37:50.988358 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:37:50.989724 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-5ecfe556-b2e4-4be0-b3a2-50c4b6721161 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Returning 404 to user: Instance 51d3266a-292e-4fce-a594-e8cbda085c6e could not be found. {{(pid=118741) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 09:37:50.989724 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-5ecfe556-b2e4-4be0-b3a2-50c4b6721161 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/51d3266a-292e-4fce-a594-e8cbda085c6e" status: 404 len: 111 microversion: 2.1 time: 0.029478 Jun 07 09:37:50.989724 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 503/1006] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:37:50 2022] GET /compute/v2.1/servers/51d3266a-292e-4fce-a594-e8cbda085c6e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 09:37:50.989996 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-baf9440d-2c33-4e39-b864-6b3a0e1ce182 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '.version_select at 0x7f5c91e5f4c0>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:51.080167 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-baf9440d-2c33-4e39-b864-6b3a0e1ce182 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1324739976" status: 202 len: 0 microversion: 2.1 time: 0.094329 Jun 07 09:37:51.080785 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 504/1007] 10.222.0.57 () {58 vars in 1220 bytes} [Tue Jun 7 09:37:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1324739976 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 09:37:51.314818 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-00219217-8220-489c-8560-dfcd27bc95cd tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:51.315582 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-00219217-8220-489c-8560-dfcd27bc95cd tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] [instance: dd2acb94-efe3-4c28-b597-21b0cfa1f27d] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:51.322375 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-00219217-8220-489c-8560-dfcd27bc95cd tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:51.322963 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-00219217-8220-489c-8560-dfcd27bc95cd tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:51.323792 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-00219217-8220-489c-8560-dfcd27bc95cd tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:51.324240 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-00219217-8220-489c-8560-dfcd27bc95cd tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:51.328424 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:37:51.454912 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-00219217-8220-489c-8560-dfcd27bc95cd tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db3cd25f4c94640854677709d10ccbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0e917f30d3430bb088ca3d0afe1a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:51.463058 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-00219217-8220-489c-8560-dfcd27bc95cd tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] 10.222.0.57 "GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d" status: 200 len: 1575 microversion: 2.1 time: 0.152293 Jun 07 09:37:51.463625 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 504/1008] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:37:51 2022] GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:37:52.480800 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-f372a7ce-a804-4337-8957-dd19ef205417 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:52.481448 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-f372a7ce-a804-4337-8957-dd19ef205417 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] [instance: dd2acb94-efe3-4c28-b597-21b0cfa1f27d] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:52.487368 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-f372a7ce-a804-4337-8957-dd19ef205417 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:52.487857 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-f372a7ce-a804-4337-8957-dd19ef205417 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:52.488637 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-f372a7ce-a804-4337-8957-dd19ef205417 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:52.489073 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-f372a7ce-a804-4337-8957-dd19ef205417 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:52.619204 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-f372a7ce-a804-4337-8957-dd19ef205417 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db3cd25f4c94640854677709d10ccbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0e917f30d3430bb088ca3d0afe1a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:52.627188 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-f372a7ce-a804-4337-8957-dd19ef205417 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] 10.222.0.57 "GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d" status: 200 len: 1575 microversion: 2.1 time: 0.150827 Jun 07 09:37:52.627752 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 505/1009] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:37:52 2022] GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:37:53.645392 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-2e167c6e-3698-4057-9621-35f53b993a94 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:53.646041 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-2e167c6e-3698-4057-9621-35f53b993a94 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] [instance: dd2acb94-efe3-4c28-b597-21b0cfa1f27d] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:53.652446 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-2e167c6e-3698-4057-9621-35f53b993a94 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:53.652967 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-2e167c6e-3698-4057-9621-35f53b993a94 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:53.653721 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-2e167c6e-3698-4057-9621-35f53b993a94 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:53.654161 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-2e167c6e-3698-4057-9621-35f53b993a94 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:53.789392 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-2e167c6e-3698-4057-9621-35f53b993a94 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db3cd25f4c94640854677709d10ccbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0e917f30d3430bb088ca3d0afe1a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:53.796880 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-2e167c6e-3698-4057-9621-35f53b993a94 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] 10.222.0.57 "GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d" status: 200 len: 1575 microversion: 2.1 time: 0.156172 Jun 07 09:37:53.797447 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 505/1010] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:37:53 2022] GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:37:54.297153 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-cdf58ed7-b961-4f70-85d1-2a8d71fe7d43 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:54.297655 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-cdf58ed7-b961-4f70-85d1-2a8d71fe7d43 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 51d3266a-292e-4fce-a594-e8cbda085c6e] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:54.304779 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-cdf58ed7-b961-4f70-85d1-2a8d71fe7d43 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:54.305289 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-cdf58ed7-b961-4f70-85d1-2a8d71fe7d43 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:54.306060 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-cdf58ed7-b961-4f70-85d1-2a8d71fe7d43 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:54.306501 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-cdf58ed7-b961-4f70-85d1-2a8d71fe7d43 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:54.319298 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.wsgi [None req-cdf58ed7-b961-4f70-85d1-2a8d71fe7d43 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] HTTP exception thrown: Instance 51d3266a-292e-4fce-a594-e8cbda085c6e could not be found. Jun 07 09:37:54.320990 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-cdf58ed7-b961-4f70-85d1-2a8d71fe7d43 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Request method failure captured: Jun 07 09:37:54.320990 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: request: DELETE /compute/v2.1/servers/51d3266a-292e-4fce-a594-e8cbda085c6e HTTP/1.1 Jun 07 09:37:54.320990 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Accept: application/json Jun 07 09:37:54.320990 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Accept-Encoding: identity Jun 07 09:37:54.320990 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Connection: close Jun 07 09:37:54.320990 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Content-Length: 0 Jun 07 09:37:54.320990 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Content-Type: application/json Jun 07 09:37:54.320990 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Host: 10.222.0.57 Jun 07 09:37:54.320990 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Openstack-System-Scope: None Jun 07 09:37:54.320990 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: User-Agent: python-urllib3/1.26.9 Jun 07 09:37:54.320990 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Auth-Token: gAAAAABinxo-GawitE_ljpo8B3KPmM3zA3tdmInFKZArRihdFF0HX1G_wnI2oEs2A5OOMQzXUhFYEU3gmYemELsFy4IB2D5fZhyTXLoqx77Bd6giA_LvjMizTHW06nxTaYAdAHd4mxE0GXaJWwbxbkTRGlHLHeGTFfVba_ZXV9BP3j69OQIBYg8 Jun 07 09:37:54.320990 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Domain-Id: None Jun 07 09:37:54.320990 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Domain-Name: None Jun 07 09:37:54.320990 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Identity-Status: Confirmed Jun 07 09:37:54.320990 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Is-Admin-Project: True Jun 07 09:37:54.320990 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Domain-Id: default Jun 07 09:37:54.320990 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Domain-Name: Default Jun 07 09:37:54.320990 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Id: 1c21b1cbbd604d6d9c97ab7c3c788f3d Jun 07 09:37:54.320990 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Name: tempest-AttachVolumeTestJSON-1184144367 Jun 07 09:37:54.320990 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Role: reader,member Jun 07 09:37:54.320990 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Roles: reader,member Jun 07 09:37:54.322546 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1c21b1cbbd604d6d9c97ab7c3c788f3d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1c21b1cbbd604d6d9c97ab7c3c788f3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1c21b1cbbd604d6d9c97ab7c3c788f3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1c21b1cbbd604d6d9c97ab7c3c788f3d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 07 09:37:54.322546 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Tenant: tempest-AttachVolumeTestJSON-1184144367 Jun 07 09:37:54.322546 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Tenant-Id: 1c21b1cbbd604d6d9c97ab7c3c788f3d Jun 07 09:37:54.322546 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1184144367 Jun 07 09:37:54.322546 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User: tempest-AttachVolumeTestJSON-1184144367-project Jun 07 09:37:54.322546 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Domain-Id: default Jun 07 09:37:54.322546 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Domain-Name: Default Jun 07 09:37:54.322546 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Id: 0346f4e3855142059983083e71c2c0c3 Jun 07 09:37:54.322546 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Name: tempest-AttachVolumeTestJSON-1184144367-project Jun 07 09:37:54.322546 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: method: > Jun 07 09:37:54.322546 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: exception: Instance 51d3266a-292e-4fce-a594-e8cbda085c6e could not be found. Jun 07 09:37:54.322546 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: action_args: {'id': '51d3266a-292e-4fce-a594-e8cbda085c6e'} Jun 07 09:37:54.323479 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 09:37:54.323479 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:37:54.323479 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 09:37:54.323479 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 09:37:54.323479 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 09:37:54.323479 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 09:37:54.323479 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 09:37:54.323479 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 09:37:54.323479 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 09:37:54.323479 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 09:37:54.323479 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51d3266a-292e-4fce-a594-e8cbda085c6e could not be found. Jun 07 09:37:54.323479 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:37:54.323479 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:37:54.323479 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:37:54.323479 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:37:54.323479 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:37:54.323479 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:37:54.323479 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 09:37:54.323479 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 09:37:54.323479 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 09:37:54.325087 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 09:37:54.325087 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 07 09:37:54.325087 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 07 09:37:54.325087 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 07 09:37:54.325087 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 07 09:37:54.325087 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 09:37:54.325087 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 09:37:54.325087 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 09:37:54.325087 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 09:37:54.325087 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51d3266a-292e-4fce-a594-e8cbda085c6e could not be found. Jun 07 09:37:54.325087 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:37:54.325087 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:37:54.325087 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:37:54.325087 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:37:54.325087 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:37:54.325087 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:37:54.325087 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 09:37:54.325087 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 09:37:54.325087 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51d3266a-292e-4fce-a594-e8cbda085c6e could not be found. Jun 07 09:37:54.325087 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:37:54.326563 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-cdf58ed7-b961-4f70-85d1-2a8d71fe7d43 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Returning 404 to user: Instance 51d3266a-292e-4fce-a594-e8cbda085c6e could not be found. {{(pid=118740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 09:37:54.326563 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-cdf58ed7-b961-4f70-85d1-2a8d71fe7d43 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "DELETE /compute/v2.1/servers/51d3266a-292e-4fce-a594-e8cbda085c6e" status: 404 len: 111 microversion: 2.1 time: 0.029016 Jun 07 09:37:54.326563 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 506/1011] 10.222.0.57 () {58 vars in 1238 bytes} [Tue Jun 7 09:37:54 2022] DELETE /compute/v2.1/servers/51d3266a-292e-4fce-a594-e8cbda085c6e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 09:37:54.331708 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-4bb4573e-1ba8-4e7d-bd8d-b9864aa31212 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:54.332323 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-4bb4573e-1ba8-4e7d-bd8d-b9864aa31212 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 51d3266a-292e-4fce-a594-e8cbda085c6e] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:54.338391 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-4bb4573e-1ba8-4e7d-bd8d-b9864aa31212 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:54.338848 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-4bb4573e-1ba8-4e7d-bd8d-b9864aa31212 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:54.339610 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-4bb4573e-1ba8-4e7d-bd8d-b9864aa31212 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:54.340047 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-4bb4573e-1ba8-4e7d-bd8d-b9864aa31212 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:54.354411 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.wsgi [None req-4bb4573e-1ba8-4e7d-bd8d-b9864aa31212 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] HTTP exception thrown: Instance 51d3266a-292e-4fce-a594-e8cbda085c6e could not be found. Jun 07 09:37:54.355955 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-4bb4573e-1ba8-4e7d-bd8d-b9864aa31212 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Request method failure captured: Jun 07 09:37:54.355955 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: request: GET /compute/v2.1/servers/51d3266a-292e-4fce-a594-e8cbda085c6e HTTP/1.1 Jun 07 09:37:54.355955 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Accept: application/json Jun 07 09:37:54.355955 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Accept-Encoding: identity Jun 07 09:37:54.355955 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Connection: close Jun 07 09:37:54.355955 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Content-Length: 0 Jun 07 09:37:54.355955 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Content-Type: application/json Jun 07 09:37:54.355955 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Host: 10.222.0.57 Jun 07 09:37:54.355955 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Openstack-System-Scope: None Jun 07 09:37:54.355955 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: User-Agent: python-urllib3/1.26.9 Jun 07 09:37:54.355955 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Auth-Token: gAAAAABinxo-GawitE_ljpo8B3KPmM3zA3tdmInFKZArRihdFF0HX1G_wnI2oEs2A5OOMQzXUhFYEU3gmYemELsFy4IB2D5fZhyTXLoqx77Bd6giA_LvjMizTHW06nxTaYAdAHd4mxE0GXaJWwbxbkTRGlHLHeGTFfVba_ZXV9BP3j69OQIBYg8 Jun 07 09:37:54.355955 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Domain-Id: None Jun 07 09:37:54.355955 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Domain-Name: None Jun 07 09:37:54.355955 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Identity-Status: Confirmed Jun 07 09:37:54.355955 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Is-Admin-Project: True Jun 07 09:37:54.355955 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Project-Domain-Id: default Jun 07 09:37:54.355955 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Project-Domain-Name: Default Jun 07 09:37:54.355955 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Project-Id: 1c21b1cbbd604d6d9c97ab7c3c788f3d Jun 07 09:37:54.355955 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Project-Name: tempest-AttachVolumeTestJSON-1184144367 Jun 07 09:37:54.355955 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Role: reader,member Jun 07 09:37:54.355955 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Roles: reader,member Jun 07 09:37:54.357594 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1c21b1cbbd604d6d9c97ab7c3c788f3d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1c21b1cbbd604d6d9c97ab7c3c788f3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1c21b1cbbd604d6d9c97ab7c3c788f3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1c21b1cbbd604d6d9c97ab7c3c788f3d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 07 09:37:54.357594 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Tenant: tempest-AttachVolumeTestJSON-1184144367 Jun 07 09:37:54.357594 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Tenant-Id: 1c21b1cbbd604d6d9c97ab7c3c788f3d Jun 07 09:37:54.357594 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1184144367 Jun 07 09:37:54.357594 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User: tempest-AttachVolumeTestJSON-1184144367-project Jun 07 09:37:54.357594 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User-Domain-Id: default Jun 07 09:37:54.357594 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User-Domain-Name: Default Jun 07 09:37:54.357594 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User-Id: 0346f4e3855142059983083e71c2c0c3 Jun 07 09:37:54.357594 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User-Name: tempest-AttachVolumeTestJSON-1184144367-project Jun 07 09:37:54.357594 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: method: > Jun 07 09:37:54.357594 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: exception: Instance 51d3266a-292e-4fce-a594-e8cbda085c6e could not be found. Jun 07 09:37:54.357594 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: action_args: {'id': '51d3266a-292e-4fce-a594-e8cbda085c6e'} Jun 07 09:37:54.358428 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 09:37:54.358428 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:37:54.358428 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 09:37:54.358428 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 09:37:54.358428 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 09:37:54.358428 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 09:37:54.358428 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 09:37:54.358428 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 09:37:54.358428 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 09:37:54.358428 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 09:37:54.358428 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51d3266a-292e-4fce-a594-e8cbda085c6e could not be found. Jun 07 09:37:54.358428 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:37:54.358428 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:37:54.358428 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:37:54.358428 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:37:54.358428 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:37:54.358428 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:37:54.358428 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 09:37:54.358428 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 09:37:54.358428 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 09:37:54.359882 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 09:37:54.359882 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 09:37:54.359882 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 09:37:54.359882 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 09:37:54.359882 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 09:37:54.359882 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 09:37:54.359882 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 09:37:54.359882 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51d3266a-292e-4fce-a594-e8cbda085c6e could not be found. Jun 07 09:37:54.359882 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:37:54.359882 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:37:54.359882 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:37:54.359882 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:37:54.359882 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:37:54.359882 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:37:54.359882 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 09:37:54.359882 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 09:37:54.359882 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51d3266a-292e-4fce-a594-e8cbda085c6e could not be found. Jun 07 09:37:54.359882 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:37:54.361741 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-4bb4573e-1ba8-4e7d-bd8d-b9864aa31212 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Returning 404 to user: Instance 51d3266a-292e-4fce-a594-e8cbda085c6e could not be found. {{(pid=118741) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 09:37:54.361741 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-4bb4573e-1ba8-4e7d-bd8d-b9864aa31212 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/51d3266a-292e-4fce-a594-e8cbda085c6e" status: 404 len: 111 microversion: 2.1 time: 0.029426 Jun 07 09:37:54.361741 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 506/1012] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:37:54 2022] GET /compute/v2.1/servers/51d3266a-292e-4fce-a594-e8cbda085c6e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 09:37:54.815314 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-646c3139-7dd4-4371-ac95-dbd92154b34d tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:54.815850 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-646c3139-7dd4-4371-ac95-dbd92154b34d tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] [instance: dd2acb94-efe3-4c28-b597-21b0cfa1f27d] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:54.821854 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-646c3139-7dd4-4371-ac95-dbd92154b34d tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:54.822301 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-646c3139-7dd4-4371-ac95-dbd92154b34d tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:54.823054 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-646c3139-7dd4-4371-ac95-dbd92154b34d tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:54.823485 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-646c3139-7dd4-4371-ac95-dbd92154b34d tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:54.957870 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-646c3139-7dd4-4371-ac95-dbd92154b34d tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db3cd25f4c94640854677709d10ccbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0e917f30d3430bb088ca3d0afe1a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:54.965436 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-646c3139-7dd4-4371-ac95-dbd92154b34d tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] 10.222.0.57 "GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d" status: 200 len: 1575 microversion: 2.1 time: 0.154733 Jun 07 09:37:54.965990 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 507/1013] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:37:54 2022] GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:37:55.087604 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [req-0dc6c517-53e5-48c4-9feb-6e3a2799792f req-b598df41-149b-4972-8a9d-e5507b0053d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd2acb94-efe3-4c28-b597-21b0cfa1f27d", "name": "network-vif-plugged", "status": "completed", "tag": "b980d237-cae5-40fe-89ff-abe6de093fce"}]} {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:37:55.097408 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [req-0dc6c517-53e5-48c4-9feb-6e3a2799792f req-b598df41-149b-4972-8a9d-e5507b0053d4 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:55.097852 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [req-0dc6c517-53e5-48c4-9feb-6e3a2799792f req-b598df41-149b-4972-8a9d-e5507b0053d4 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:55.109004 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.compute.server_external_events [req-0dc6c517-53e5-48c4-9feb-6e3a2799792f req-b598df41-149b-4972-8a9d-e5507b0053d4 service nova] Creating event network-vif-plugged:b980d237-cae5-40fe-89ff-abe6de093fce for instance dd2acb94-efe3-4c28-b597-21b0cfa1f27d on hv-cinder-83699 Jun 07 09:37:55.114800 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [req-0dc6c517-53e5-48c4-9feb-6e3a2799792f req-b598df41-149b-4972-8a9d-e5507b0053d4 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031077 Jun 07 09:37:55.115612 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 507/1014] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Jun 7 09:37:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:37:55.594648 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-3ddee8bb-9b18-4c43-a91d-2f99987a050c tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:55.595823 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-3ddee8bb-9b18-4c43-a91d-2f99987a050c tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:55.602510 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-3ddee8bb-9b18-4c43-a91d-2f99987a050c tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:55.602960 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-3ddee8bb-9b18-4c43-a91d-2f99987a050c tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:55.603721 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-3ddee8bb-9b18-4c43-a91d-2f99987a050c tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:55.604157 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-3ddee8bb-9b18-4c43-a91d-2f99987a050c tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:55.617185 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.wsgi [None req-3ddee8bb-9b18-4c43-a91d-2f99987a050c tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] HTTP exception thrown: Instance 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 could not be found. Jun 07 09:37:55.618743 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-3ddee8bb-9b18-4c43-a91d-2f99987a050c tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Request method failure captured: Jun 07 09:37:55.618743 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: request: DELETE /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 HTTP/1.1 Jun 07 09:37:55.618743 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Accept: application/json Jun 07 09:37:55.618743 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Accept-Encoding: identity Jun 07 09:37:55.618743 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Connection: close Jun 07 09:37:55.618743 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Content-Length: 0 Jun 07 09:37:55.618743 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Content-Type: application/json Jun 07 09:37:55.618743 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Host: 10.222.0.57 Jun 07 09:37:55.618743 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Openstack-System-Scope: None Jun 07 09:37:55.618743 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: User-Agent: python-urllib3/1.26.9 Jun 07 09:37:55.618743 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Auth-Token: gAAAAABinxo-GawitE_ljpo8B3KPmM3zA3tdmInFKZArRihdFF0HX1G_wnI2oEs2A5OOMQzXUhFYEU3gmYemELsFy4IB2D5fZhyTXLoqx77Bd6giA_LvjMizTHW06nxTaYAdAHd4mxE0GXaJWwbxbkTRGlHLHeGTFfVba_ZXV9BP3j69OQIBYg8 Jun 07 09:37:55.618743 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Domain-Id: None Jun 07 09:37:55.618743 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Domain-Name: None Jun 07 09:37:55.618743 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Identity-Status: Confirmed Jun 07 09:37:55.618743 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Is-Admin-Project: True Jun 07 09:37:55.618743 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Domain-Id: default Jun 07 09:37:55.618743 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Domain-Name: Default Jun 07 09:37:55.618743 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Id: 1c21b1cbbd604d6d9c97ab7c3c788f3d Jun 07 09:37:55.618743 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Name: tempest-AttachVolumeTestJSON-1184144367 Jun 07 09:37:55.618743 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Role: reader,member Jun 07 09:37:55.618743 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Roles: reader,member Jun 07 09:37:55.620310 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1c21b1cbbd604d6d9c97ab7c3c788f3d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1c21b1cbbd604d6d9c97ab7c3c788f3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1c21b1cbbd604d6d9c97ab7c3c788f3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1c21b1cbbd604d6d9c97ab7c3c788f3d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 07 09:37:55.620310 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Tenant: tempest-AttachVolumeTestJSON-1184144367 Jun 07 09:37:55.620310 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Tenant-Id: 1c21b1cbbd604d6d9c97ab7c3c788f3d Jun 07 09:37:55.620310 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1184144367 Jun 07 09:37:55.620310 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User: tempest-AttachVolumeTestJSON-1184144367-project Jun 07 09:37:55.620310 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Domain-Id: default Jun 07 09:37:55.620310 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Domain-Name: Default Jun 07 09:37:55.620310 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Id: 0346f4e3855142059983083e71c2c0c3 Jun 07 09:37:55.620310 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Name: tempest-AttachVolumeTestJSON-1184144367-project Jun 07 09:37:55.620310 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: method: > Jun 07 09:37:55.620310 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: exception: Instance 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 could not be found. Jun 07 09:37:55.620310 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: action_args: {'id': '8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25'} Jun 07 09:37:55.621267 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 09:37:55.621267 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:37:55.621267 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 09:37:55.621267 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 09:37:55.621267 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 09:37:55.621267 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 09:37:55.621267 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 09:37:55.621267 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 09:37:55.621267 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 09:37:55.621267 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 09:37:55.621267 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 could not be found. Jun 07 09:37:55.621267 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:37:55.621267 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:37:55.621267 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:37:55.621267 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:37:55.621267 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:37:55.621267 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:37:55.621267 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 09:37:55.621267 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 09:37:55.621267 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 09:37:55.622698 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 09:37:55.622698 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 07 09:37:55.622698 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 07 09:37:55.622698 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 07 09:37:55.622698 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 07 09:37:55.622698 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 09:37:55.622698 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 09:37:55.622698 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 09:37:55.622698 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 09:37:55.622698 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 could not be found. Jun 07 09:37:55.622698 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:37:55.622698 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:37:55.622698 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:37:55.622698 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:37:55.622698 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:37:55.622698 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:37:55.622698 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 09:37:55.622698 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 09:37:55.622698 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 could not be found. Jun 07 09:37:55.622698 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:37:55.624252 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-3ddee8bb-9b18-4c43-a91d-2f99987a050c tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Returning 404 to user: Instance 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 could not be found. {{(pid=118740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 09:37:55.624252 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-3ddee8bb-9b18-4c43-a91d-2f99987a050c tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "DELETE /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25" status: 404 len: 111 microversion: 2.1 time: 0.029276 Jun 07 09:37:55.624252 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 508/1015] 10.222.0.57 () {58 vars in 1238 bytes} [Tue Jun 7 09:37:55 2022] DELETE /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 09:37:55.629253 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-6e0429bc-7753-4a79-a0cd-b3b42a42e078 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:55.629955 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-6e0429bc-7753-4a79-a0cd-b3b42a42e078 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] [instance: 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:55.636191 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-6e0429bc-7753-4a79-a0cd-b3b42a42e078 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:55.636519 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-6e0429bc-7753-4a79-a0cd-b3b42a42e078 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:55.637323 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-6e0429bc-7753-4a79-a0cd-b3b42a42e078 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:55.637757 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-6e0429bc-7753-4a79-a0cd-b3b42a42e078 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:55.651611 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.wsgi [None req-6e0429bc-7753-4a79-a0cd-b3b42a42e078 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] HTTP exception thrown: Instance 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 could not be found. Jun 07 09:37:55.653235 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-6e0429bc-7753-4a79-a0cd-b3b42a42e078 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Request method failure captured: Jun 07 09:37:55.653235 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: request: GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 HTTP/1.1 Jun 07 09:37:55.653235 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Accept: application/json Jun 07 09:37:55.653235 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Accept-Encoding: identity Jun 07 09:37:55.653235 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Connection: close Jun 07 09:37:55.653235 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Content-Length: 0 Jun 07 09:37:55.653235 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Content-Type: application/json Jun 07 09:37:55.653235 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Host: 10.222.0.57 Jun 07 09:37:55.653235 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Openstack-System-Scope: None Jun 07 09:37:55.653235 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: User-Agent: python-urllib3/1.26.9 Jun 07 09:37:55.653235 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Auth-Token: gAAAAABinxo-GawitE_ljpo8B3KPmM3zA3tdmInFKZArRihdFF0HX1G_wnI2oEs2A5OOMQzXUhFYEU3gmYemELsFy4IB2D5fZhyTXLoqx77Bd6giA_LvjMizTHW06nxTaYAdAHd4mxE0GXaJWwbxbkTRGlHLHeGTFfVba_ZXV9BP3j69OQIBYg8 Jun 07 09:37:55.653235 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Domain-Id: None Jun 07 09:37:55.653235 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Domain-Name: None Jun 07 09:37:55.653235 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Identity-Status: Confirmed Jun 07 09:37:55.653235 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Is-Admin-Project: True Jun 07 09:37:55.653235 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Project-Domain-Id: default Jun 07 09:37:55.653235 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Project-Domain-Name: Default Jun 07 09:37:55.653235 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Project-Id: 1c21b1cbbd604d6d9c97ab7c3c788f3d Jun 07 09:37:55.653235 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Project-Name: tempest-AttachVolumeTestJSON-1184144367 Jun 07 09:37:55.653235 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Role: reader,member Jun 07 09:37:55.653235 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Roles: reader,member Jun 07 09:37:55.654794 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1c21b1cbbd604d6d9c97ab7c3c788f3d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1c21b1cbbd604d6d9c97ab7c3c788f3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1c21b1cbbd604d6d9c97ab7c3c788f3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1c21b1cbbd604d6d9c97ab7c3c788f3d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 07 09:37:55.654794 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Tenant: tempest-AttachVolumeTestJSON-1184144367 Jun 07 09:37:55.654794 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Tenant-Id: 1c21b1cbbd604d6d9c97ab7c3c788f3d Jun 07 09:37:55.654794 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1184144367 Jun 07 09:37:55.654794 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User: tempest-AttachVolumeTestJSON-1184144367-project Jun 07 09:37:55.654794 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User-Domain-Id: default Jun 07 09:37:55.654794 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User-Domain-Name: Default Jun 07 09:37:55.654794 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User-Id: 0346f4e3855142059983083e71c2c0c3 Jun 07 09:37:55.654794 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User-Name: tempest-AttachVolumeTestJSON-1184144367-project Jun 07 09:37:55.654794 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: method: > Jun 07 09:37:55.654794 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: exception: Instance 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 could not be found. Jun 07 09:37:55.654794 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: action_args: {'id': '8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25'} Jun 07 09:37:55.655847 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 09:37:55.655847 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:37:55.655847 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 09:37:55.655847 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 09:37:55.655847 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 09:37:55.655847 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 09:37:55.655847 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 09:37:55.655847 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 09:37:55.655847 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 09:37:55.655847 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 09:37:55.655847 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 could not be found. Jun 07 09:37:55.655847 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:37:55.655847 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:37:55.655847 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:37:55.655847 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:37:55.655847 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:37:55.655847 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:37:55.655847 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 09:37:55.655847 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 09:37:55.655847 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 09:37:55.657419 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 09:37:55.657419 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 09:37:55.657419 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 09:37:55.657419 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 09:37:55.657419 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 09:37:55.657419 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 09:37:55.657419 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 09:37:55.657419 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 could not be found. Jun 07 09:37:55.657419 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:37:55.657419 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:37:55.657419 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:37:55.657419 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:37:55.657419 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:37:55.657419 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:37:55.657419 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 09:37:55.657419 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 09:37:55.657419 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 could not be found. Jun 07 09:37:55.657419 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:37:55.658999 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-6e0429bc-7753-4a79-a0cd-b3b42a42e078 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] Returning 404 to user: Instance 8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 could not be found. {{(pid=118741) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 09:37:55.658999 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-6e0429bc-7753-4a79-a0cd-b3b42a42e078 tempest-AttachVolumeTestJSON-1184144367 tempest-AttachVolumeTestJSON-1184144367-project] 10.222.0.57 "GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25" status: 404 len: 111 microversion: 2.1 time: 0.030037 Jun 07 09:37:55.658999 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 508/1016] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:37:55 2022] GET /compute/v2.1/servers/8ff0a797-4ea0-4c3d-ba48-e0dd98e76e25 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 09:37:55.984448 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-e6ae3907-2df0-4505-9809-b9f67defa1f5 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:55.985081 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-e6ae3907-2df0-4505-9809-b9f67defa1f5 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] [instance: dd2acb94-efe3-4c28-b597-21b0cfa1f27d] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:55.991469 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-e6ae3907-2df0-4505-9809-b9f67defa1f5 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:55.991925 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-e6ae3907-2df0-4505-9809-b9f67defa1f5 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:55.992737 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-e6ae3907-2df0-4505-9809-b9f67defa1f5 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:55.993182 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-e6ae3907-2df0-4505-9809-b9f67defa1f5 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:56.008887 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writing DB stats nova_cell1:SELECT=100 {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:37:56.215184 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-e6ae3907-2df0-4505-9809-b9f67defa1f5 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db3cd25f4c94640854677709d10ccbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0e917f30d3430bb088ca3d0afe1a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:56.223140 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-e6ae3907-2df0-4505-9809-b9f67defa1f5 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] 10.222.0.57 "GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d" status: 200 len: 1575 microversion: 2.1 time: 0.243689 Jun 07 09:37:56.223711 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 509/1017] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:37:55 2022] GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d => generated 1575 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:37:57.241445 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-c45b7a0e-957d-4200-b40f-6daf9e558fe3 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:37:57.242044 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-c45b7a0e-957d-4200-b40f-6daf9e558fe3 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] [instance: dd2acb94-efe3-4c28-b597-21b0cfa1f27d] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:37:57.244627 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1 {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:37:57.249433 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-c45b7a0e-957d-4200-b40f-6daf9e558fe3 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:57.249877 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-c45b7a0e-957d-4200-b40f-6daf9e558fe3 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:57.250642 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-c45b7a0e-957d-4200-b40f-6daf9e558fe3 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:37:57.251446 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-c45b7a0e-957d-4200-b40f-6daf9e558fe3 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:37:57.384362 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-c45b7a0e-957d-4200-b40f-6daf9e558fe3 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db3cd25f4c94640854677709d10ccbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0e917f30d3430bb088ca3d0afe1a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:37:57.392123 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-c45b7a0e-957d-4200-b40f-6daf9e558fe3 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] 10.222.0.57 "GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d" status: 200 len: 1562 microversion: 2.1 time: 0.154607 Jun 07 09:37:57.392723 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 509/1018] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:37:57 2022] GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d => generated 1562 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:38:07.402311 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-0ea57453-68b5-4965-8d80-a54bb1ff2a1f tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:38:07.402888 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-0ea57453-68b5-4965-8d80-a54bb1ff2a1f tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 99a619a0-6d18-47e7-bbdf-811c2949405d] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:38:07.405165 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writing DB stats nova_api:SELECT=30,nova_api:DELETE=1 {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:38:07.406762 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writing DB stats nova_cell1:SELECT=3 {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:38:07.412604 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-0ea57453-68b5-4965-8d80-a54bb1ff2a1f tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:38:07.413056 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-0ea57453-68b5-4965-8d80-a54bb1ff2a1f tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:38:07.414957 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-0ea57453-68b5-4965-8d80-a54bb1ff2a1f tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:38:07.414957 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-0ea57453-68b5-4965-8d80-a54bb1ff2a1f tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:38:07.438945 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-0ea57453-68b5-4965-8d80-a54bb1ff2a1f tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/99a619a0-6d18-47e7-bbdf-811c2949405d/ips" status: 200 len: 149 microversion: 2.1 time: 0.040567 Jun 07 09:38:07.439503 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 510/1019] 10.222.0.57 () {58 vars in 1247 bytes} [Tue Jun 7 09:38:07 2022] GET /compute/v2.1/servers/99a619a0-6d18-47e7-bbdf-811c2949405d/ips => generated 149 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:38:11.023038 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-a176f721-da39-446e-a6a2-e3b22c07b309 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aa5c3e1c-fa4a-452e-b95a-61217282d646"}} {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:38:11.024365 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-a176f721-da39-446e-a6a2-e3b22c07b309 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 99a619a0-6d18-47e7-bbdf-811c2949405d] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:38:11.026463 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writing DB stats nova_cell1:SELECT=22 {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:38:11.031363 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-a176f721-da39-446e-a6a2-e3b22c07b309 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:38:11.031816 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-a176f721-da39-446e-a6a2-e3b22c07b309 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:38:11.032595 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-a176f721-da39-446e-a6a2-e3b22c07b309 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:38:11.033039 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-a176f721-da39-446e-a6a2-e3b22c07b309 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:38:11.882770 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-a176f721-da39-446e-a6a2-e3b22c07b309 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "POST /compute/v2.1/servers/99a619a0-6d18-47e7-bbdf-811c2949405d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.864392 Jun 07 09:38:11.883370 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 510/1020] 10.222.0.57 () {60 vars in 1322 bytes} [Tue Jun 7 09:38:11 2022] POST /compute/v2.1/servers/99a619a0-6d18-47e7-bbdf-811c2949405d/os-volume_attachments => generated 194 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:38:20.521512 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-360177b1-8248-4db5-a9b8-c8fd80420bc1 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:38:20.530924 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-360177b1-8248-4db5-a9b8-c8fd80420bc1 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 99a619a0-6d18-47e7-bbdf-811c2949405d] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:38:20.530924 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-360177b1-8248-4db5-a9b8-c8fd80420bc1 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:38:20.530924 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-360177b1-8248-4db5-a9b8-c8fd80420bc1 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:38:20.531615 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-360177b1-8248-4db5-a9b8-c8fd80420bc1 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:38:20.532051 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-360177b1-8248-4db5-a9b8-c8fd80420bc1 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:38:20.611220 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.objects.instance [None req-360177b1-8248-4db5-a9b8-c8fd80420bc1 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lazy-loading 'services' on Instance uuid 99a619a0-6d18-47e7-bbdf-811c2949405d {{(pid=118740) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 09:38:20.831652 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-360177b1-8248-4db5-a9b8-c8fd80420bc1 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "DELETE /compute/v2.1/servers/99a619a0-6d18-47e7-bbdf-811c2949405d/os-volume_attachments/aa5c3e1c-fa4a-452e-b95a-61217282d646" status: 202 len: 0 microversion: 2.1 time: 0.316191 Jun 07 09:38:20.832269 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 511/1021] 10.222.0.57 () {58 vars in 1415 bytes} [Tue Jun 7 09:38:20 2022] DELETE /compute/v2.1/servers/99a619a0-6d18-47e7-bbdf-811c2949405d/os-volume_attachments/aa5c3e1c-fa4a-452e-b95a-61217282d646 => generated 0 bytes in 318 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 07 09:38:20.841607 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-3e17d155-41b0-4c7e-bcfa-ecbc86598173 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:38:20.842849 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-3e17d155-41b0-4c7e-bcfa-ecbc86598173 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 99a619a0-6d18-47e7-bbdf-811c2949405d] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:38:20.849773 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-3e17d155-41b0-4c7e-bcfa-ecbc86598173 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:38:20.850223 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-3e17d155-41b0-4c7e-bcfa-ecbc86598173 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:38:20.851240 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-3e17d155-41b0-4c7e-bcfa-ecbc86598173 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:38:20.851676 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-3e17d155-41b0-4c7e-bcfa-ecbc86598173 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:38:20.880439 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-3e17d155-41b0-4c7e-bcfa-ecbc86598173 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/99a619a0-6d18-47e7-bbdf-811c2949405d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043715 Jun 07 09:38:20.881056 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 511/1022] 10.222.0.57 () {58 vars in 1301 bytes} [Tue Jun 7 09:38:20 2022] GET /compute/v2.1/servers/99a619a0-6d18-47e7-bbdf-811c2949405d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:38:21.892495 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-69bf4bba-f567-40da-ab9a-4bdcf4afcae9 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:38:21.893570 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-69bf4bba-f567-40da-ab9a-4bdcf4afcae9 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 99a619a0-6d18-47e7-bbdf-811c2949405d] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:38:21.899793 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-69bf4bba-f567-40da-ab9a-4bdcf4afcae9 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:38:21.900254 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-69bf4bba-f567-40da-ab9a-4bdcf4afcae9 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:38:21.902766 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-69bf4bba-f567-40da-ab9a-4bdcf4afcae9 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:38:21.902766 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-69bf4bba-f567-40da-ab9a-4bdcf4afcae9 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:38:21.932131 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-69bf4bba-f567-40da-ab9a-4bdcf4afcae9 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/99a619a0-6d18-47e7-bbdf-811c2949405d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044464 Jun 07 09:38:21.932729 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 512/1023] 10.222.0.57 () {58 vars in 1301 bytes} [Tue Jun 7 09:38:21 2022] GET /compute/v2.1/servers/99a619a0-6d18-47e7-bbdf-811c2949405d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:38:22.943927 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-1889ea87-7c1f-440c-a986-2b17fd44f642 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:38:22.944904 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-1889ea87-7c1f-440c-a986-2b17fd44f642 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 99a619a0-6d18-47e7-bbdf-811c2949405d] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:38:22.951442 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-1889ea87-7c1f-440c-a986-2b17fd44f642 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:38:22.951896 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-1889ea87-7c1f-440c-a986-2b17fd44f642 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:38:22.952697 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-1889ea87-7c1f-440c-a986-2b17fd44f642 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:38:22.953138 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-1889ea87-7c1f-440c-a986-2b17fd44f642 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:38:22.981726 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-1889ea87-7c1f-440c-a986-2b17fd44f642 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/99a619a0-6d18-47e7-bbdf-811c2949405d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042313 Jun 07 09:38:22.982278 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 512/1024] 10.222.0.57 () {58 vars in 1301 bytes} [Tue Jun 7 09:38:22 2022] GET /compute/v2.1/servers/99a619a0-6d18-47e7-bbdf-811c2949405d/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 07 09:38:23.040264 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-e205ad9a-4ef0-495c-8b76-6e1b1b545be6 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:38:23.040812 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-e205ad9a-4ef0-495c-8b76-6e1b1b545be6 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 99a619a0-6d18-47e7-bbdf-811c2949405d] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:38:23.047127 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-e205ad9a-4ef0-495c-8b76-6e1b1b545be6 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:38:23.047573 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-e205ad9a-4ef0-495c-8b76-6e1b1b545be6 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:38:23.048322 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-e205ad9a-4ef0-495c-8b76-6e1b1b545be6 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:38:23.048789 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-e205ad9a-4ef0-495c-8b76-6e1b1b545be6 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:38:23.074609 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-e205ad9a-4ef0-495c-8b76-6e1b1b545be6 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 99a619a0-6d18-47e7-bbdf-811c2949405d] Going to try to terminate instance {{(pid=118740) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 09:38:23.347549 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-e205ad9a-4ef0-495c-8b76-6e1b1b545be6 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "DELETE /compute/v2.1/servers/99a619a0-6d18-47e7-bbdf-811c2949405d" status: 204 len: 0 microversion: 2.1 time: 0.310266 Jun 07 09:38:23.348054 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 513/1025] 10.222.0.57 () {58 vars in 1238 bytes} [Tue Jun 7 09:38:23 2022] DELETE /compute/v2.1/servers/99a619a0-6d18-47e7-bbdf-811c2949405d => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 09:38:23.356568 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-1063f9cd-5c53-434a-83d9-7e0ebdacbe5c tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:38:23.357205 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-1063f9cd-5c53-434a-83d9-7e0ebdacbe5c tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 99a619a0-6d18-47e7-bbdf-811c2949405d] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:38:23.363789 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-1063f9cd-5c53-434a-83d9-7e0ebdacbe5c tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:38:23.364239 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-1063f9cd-5c53-434a-83d9-7e0ebdacbe5c tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:38:23.365027 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-1063f9cd-5c53-434a-83d9-7e0ebdacbe5c tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:38:23.365465 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-1063f9cd-5c53-434a-83d9-7e0ebdacbe5c tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:38:23.490361 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-1063f9cd-5c53-434a-83d9-7e0ebdacbe5c tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:38:23.497723 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-1063f9cd-5c53-434a-83d9-7e0ebdacbe5c tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/99a619a0-6d18-47e7-bbdf-811c2949405d" status: 200 len: 1681 microversion: 2.1 time: 0.145086 Jun 07 09:38:23.498284 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 513/1026] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:38:23 2022] GET /compute/v2.1/servers/99a619a0-6d18-47e7-bbdf-811c2949405d => generated 1681 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:38:24.515458 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-117b511c-9876-4102-b7aa-5ec89abadec5 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:38:24.516169 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-117b511c-9876-4102-b7aa-5ec89abadec5 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 99a619a0-6d18-47e7-bbdf-811c2949405d] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:38:24.523202 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-117b511c-9876-4102-b7aa-5ec89abadec5 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:38:24.523655 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-117b511c-9876-4102-b7aa-5ec89abadec5 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:38:24.524423 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-117b511c-9876-4102-b7aa-5ec89abadec5 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:38:24.524901 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-117b511c-9876-4102-b7aa-5ec89abadec5 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:38:24.807413 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-117b511c-9876-4102-b7aa-5ec89abadec5 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:38:24.814775 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-117b511c-9876-4102-b7aa-5ec89abadec5 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/99a619a0-6d18-47e7-bbdf-811c2949405d" status: 200 len: 1681 microversion: 2.1 time: 0.303592 Jun 07 09:38:24.815807 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 514/1027] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:38:24 2022] GET /compute/v2.1/servers/99a619a0-6d18-47e7-bbdf-811c2949405d => generated 1681 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:38:25.831569 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-9b1bc363-3d9c-40f0-b120-db058b961042 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:38:25.832173 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-9b1bc363-3d9c-40f0-b120-db058b961042 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 99a619a0-6d18-47e7-bbdf-811c2949405d] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:38:25.838619 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-9b1bc363-3d9c-40f0-b120-db058b961042 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:38:25.839068 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-9b1bc363-3d9c-40f0-b120-db058b961042 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:38:25.839824 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-9b1bc363-3d9c-40f0-b120-db058b961042 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:38:25.840255 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-9b1bc363-3d9c-40f0-b120-db058b961042 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:38:26.123324 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-9b1bc363-3d9c-40f0-b120-db058b961042 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:38:26.131065 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-9b1bc363-3d9c-40f0-b120-db058b961042 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/99a619a0-6d18-47e7-bbdf-811c2949405d" status: 200 len: 1681 microversion: 2.1 time: 0.303572 Jun 07 09:38:26.131629 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 514/1028] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:38:25 2022] GET /compute/v2.1/servers/99a619a0-6d18-47e7-bbdf-811c2949405d => generated 1681 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:38:26.741952 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [req-2e50dba2-5734-46fa-b8f6-d0ff509bdc5b req-0e5a78ed-6db9-4cdf-9ad4-4e0a1d1f5d31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99a619a0-6d18-47e7-bbdf-811c2949405d", "name": "network-vif-deleted", "tag": "de7081e5-144c-4179-9018-1cdedceee805"}]} {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:38:26.750479 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [req-2e50dba2-5734-46fa-b8f6-d0ff509bdc5b req-0e5a78ed-6db9-4cdf-9ad4-4e0a1d1f5d31 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:38:26.751185 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [req-2e50dba2-5734-46fa-b8f6-d0ff509bdc5b req-0e5a78ed-6db9-4cdf-9ad4-4e0a1d1f5d31 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:38:26.763591 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.compute.server_external_events [req-2e50dba2-5734-46fa-b8f6-d0ff509bdc5b req-0e5a78ed-6db9-4cdf-9ad4-4e0a1d1f5d31 service nova] Creating event network-vif-deleted:de7081e5-144c-4179-9018-1cdedceee805 for instance 99a619a0-6d18-47e7-bbdf-811c2949405d on hv-cinder-83699 Jun 07 09:38:26.768953 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [req-2e50dba2-5734-46fa-b8f6-d0ff509bdc5b req-0e5a78ed-6db9-4cdf-9ad4-4e0a1d1f5d31 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030595 Jun 07 09:38:26.769551 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 515/1029] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Jun 7 09:38:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:38:27.149003 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-25cfd719-2a0e-462e-b1ce-0597dc097b05 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:38:27.149535 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-25cfd719-2a0e-462e-b1ce-0597dc097b05 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 99a619a0-6d18-47e7-bbdf-811c2949405d] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:38:27.156077 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-25cfd719-2a0e-462e-b1ce-0597dc097b05 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:38:27.156520 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-25cfd719-2a0e-462e-b1ce-0597dc097b05 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:38:27.157320 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-25cfd719-2a0e-462e-b1ce-0597dc097b05 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:38:27.157755 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-25cfd719-2a0e-462e-b1ce-0597dc097b05 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:38:27.189478 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-25cfd719-2a0e-462e-b1ce-0597dc097b05 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:38:27.189919 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-25cfd719-2a0e-462e-b1ce-0597dc097b05 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:38:27.190634 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.objects.instance [None req-25cfd719-2a0e-462e-b1ce-0597dc097b05 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lazy-loading 'fault' on Instance uuid 99a619a0-6d18-47e7-bbdf-811c2949405d {{(pid=118741) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 09:38:27.231642 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-25cfd719-2a0e-462e-b1ce-0597dc097b05 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f32356bb0bd4234ba817db581b62aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50189b9cf3b145ba84495af8db63c41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:38:27.239895 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-25cfd719-2a0e-462e-b1ce-0597dc097b05 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/99a619a0-6d18-47e7-bbdf-811c2949405d" status: 200 len: 1331 microversion: 2.1 time: 0.094766 Jun 07 09:38:27.240492 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 515/1030] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:38:27 2022] GET /compute/v2.1/servers/99a619a0-6d18-47e7-bbdf-811c2949405d => generated 1331 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:38:28.265400 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-fcb187a7-21a2-4a39-b4fa-d230d7945651 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:38:28.266098 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-fcb187a7-21a2-4a39-b4fa-d230d7945651 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 99a619a0-6d18-47e7-bbdf-811c2949405d] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:38:28.272275 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-fcb187a7-21a2-4a39-b4fa-d230d7945651 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:38:28.272750 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-fcb187a7-21a2-4a39-b4fa-d230d7945651 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:38:28.273515 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-fcb187a7-21a2-4a39-b4fa-d230d7945651 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:38:28.273954 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-fcb187a7-21a2-4a39-b4fa-d230d7945651 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:38:28.286818 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.wsgi [None req-fcb187a7-21a2-4a39-b4fa-d230d7945651 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] HTTP exception thrown: Instance 99a619a0-6d18-47e7-bbdf-811c2949405d could not be found. Jun 07 09:38:28.288407 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-fcb187a7-21a2-4a39-b4fa-d230d7945651 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Request method failure captured: Jun 07 09:38:28.288407 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: request: GET /compute/v2.1/servers/99a619a0-6d18-47e7-bbdf-811c2949405d HTTP/1.1 Jun 07 09:38:28.288407 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Accept: application/json Jun 07 09:38:28.288407 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Accept-Encoding: identity Jun 07 09:38:28.288407 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Connection: close Jun 07 09:38:28.288407 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Content-Length: 0 Jun 07 09:38:28.288407 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Content-Type: application/json Jun 07 09:38:28.288407 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Host: 10.222.0.57 Jun 07 09:38:28.288407 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Openstack-System-Scope: None Jun 07 09:38:28.288407 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: User-Agent: python-urllib3/1.26.9 Jun 07 09:38:28.288407 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Auth-Token: gAAAAABinxpC12ZwKTW7QgnAffZ7E-ugoEXrTCPY3mQwE3_vl9PU9oHTK85PZ0XjIngREK5HYB-lK6ouZq5luxAqHs--1L8FlbsFi6dx2RXjuHSwD2ZGE9RoKs0Rdw_R-iFZYNlQhLI_1L8kAsNT9zgLS2ggWur5AvuhEXFMSEICdPE44y32YVk Jun 07 09:38:28.288407 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Domain-Id: None Jun 07 09:38:28.288407 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Domain-Name: None Jun 07 09:38:28.288407 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Identity-Status: Confirmed Jun 07 09:38:28.288407 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Is-Admin-Project: True Jun 07 09:38:28.288407 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Domain-Id: default Jun 07 09:38:28.288407 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Domain-Name: Default Jun 07 09:38:28.288407 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Id: 50189b9cf3b145ba84495af8db63c41b Jun 07 09:38:28.288407 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Name: tempest-AttachVolumeNegativeTest-238843557 Jun 07 09:38:28.288407 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Role: reader,member Jun 07 09:38:28.288407 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Roles: reader,member Jun 07 09:38:28.290076 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/50189b9cf3b145ba84495af8db63c41b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/50189b9cf3b145ba84495af8db63c41b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_50189b9cf3b145ba84495af8db63c41b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/50189b9cf3b145ba84495af8db63c41b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 07 09:38:28.290076 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Tenant: tempest-AttachVolumeNegativeTest-238843557 Jun 07 09:38:28.290076 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Tenant-Id: 50189b9cf3b145ba84495af8db63c41b Jun 07 09:38:28.290076 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-238843557 Jun 07 09:38:28.290076 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User: tempest-AttachVolumeNegativeTest-238843557-project Jun 07 09:38:28.290076 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Domain-Id: default Jun 07 09:38:28.290076 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Domain-Name: Default Jun 07 09:38:28.290076 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Id: 2f32356bb0bd4234ba817db581b62aad Jun 07 09:38:28.290076 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Name: tempest-AttachVolumeNegativeTest-238843557-project Jun 07 09:38:28.290076 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: method: > Jun 07 09:38:28.290076 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: exception: Instance 99a619a0-6d18-47e7-bbdf-811c2949405d could not be found. Jun 07 09:38:28.290076 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: action_args: {'id': '99a619a0-6d18-47e7-bbdf-811c2949405d'} Jun 07 09:38:28.290982 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 09:38:28.290982 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:38:28.290982 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 09:38:28.290982 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 09:38:28.290982 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 09:38:28.290982 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 09:38:28.290982 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 09:38:28.290982 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 09:38:28.290982 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 09:38:28.290982 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 09:38:28.290982 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99a619a0-6d18-47e7-bbdf-811c2949405d could not be found. Jun 07 09:38:28.290982 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:38:28.290982 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:38:28.290982 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:38:28.290982 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:38:28.290982 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:38:28.290982 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:38:28.290982 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 09:38:28.290982 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 09:38:28.290982 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 09:38:28.292530 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 09:38:28.292530 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 09:38:28.292530 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 09:38:28.292530 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 09:38:28.292530 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 09:38:28.292530 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 09:38:28.292530 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 09:38:28.292530 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99a619a0-6d18-47e7-bbdf-811c2949405d could not be found. Jun 07 09:38:28.292530 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:38:28.292530 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:38:28.292530 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:38:28.292530 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:38:28.292530 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:38:28.292530 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:38:28.292530 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 09:38:28.292530 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 09:38:28.292530 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99a619a0-6d18-47e7-bbdf-811c2949405d could not be found. Jun 07 09:38:28.292530 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:38:28.294194 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-fcb187a7-21a2-4a39-b4fa-d230d7945651 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Returning 404 to user: Instance 99a619a0-6d18-47e7-bbdf-811c2949405d could not be found. {{(pid=118740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 09:38:28.294194 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-fcb187a7-21a2-4a39-b4fa-d230d7945651 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/99a619a0-6d18-47e7-bbdf-811c2949405d" status: 404 len: 111 microversion: 2.1 time: 0.029128 Jun 07 09:38:28.294194 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 516/1031] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:38:28 2022] GET /compute/v2.1/servers/99a619a0-6d18-47e7-bbdf-811c2949405d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 09:38:28.298674 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-c204e3c4-abb1-4580-bff2-838a1b9b9d5a tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '.version_select at 0x7f5c92786ee0>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:38:28.364798 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-c204e3c4-abb1-4580-bff2-838a1b9b9d5a tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-675283852" status: 202 len: 0 microversion: 2.1 time: 0.069771 Jun 07 09:38:28.365372 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 516/1032] 10.222.0.57 () {58 vars in 1217 bytes} [Tue Jun 7 09:38:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-675283852 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 09:38:30.344337 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-3588bae7-3c2d-4fd9-9079-646960e20d9a tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:38:30.345061 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-3588bae7-3c2d-4fd9-9079-646960e20d9a tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 99a619a0-6d18-47e7-bbdf-811c2949405d] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:38:30.352453 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-3588bae7-3c2d-4fd9-9079-646960e20d9a tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:38:30.353018 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-3588bae7-3c2d-4fd9-9079-646960e20d9a tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:38:30.353806 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-3588bae7-3c2d-4fd9-9079-646960e20d9a tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:38:30.354277 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-3588bae7-3c2d-4fd9-9079-646960e20d9a tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:38:30.367934 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.wsgi [None req-3588bae7-3c2d-4fd9-9079-646960e20d9a tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] HTTP exception thrown: Instance 99a619a0-6d18-47e7-bbdf-811c2949405d could not be found. Jun 07 09:38:30.369495 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-3588bae7-3c2d-4fd9-9079-646960e20d9a tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Request method failure captured: Jun 07 09:38:30.369495 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: request: DELETE /compute/v2.1/servers/99a619a0-6d18-47e7-bbdf-811c2949405d HTTP/1.1 Jun 07 09:38:30.369495 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Accept: application/json Jun 07 09:38:30.369495 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Accept-Encoding: identity Jun 07 09:38:30.369495 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Connection: close Jun 07 09:38:30.369495 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Content-Length: 0 Jun 07 09:38:30.369495 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Content-Type: application/json Jun 07 09:38:30.369495 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Host: 10.222.0.57 Jun 07 09:38:30.369495 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Openstack-System-Scope: None Jun 07 09:38:30.369495 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: User-Agent: python-urllib3/1.26.9 Jun 07 09:38:30.369495 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Auth-Token: gAAAAABinxpC12ZwKTW7QgnAffZ7E-ugoEXrTCPY3mQwE3_vl9PU9oHTK85PZ0XjIngREK5HYB-lK6ouZq5luxAqHs--1L8FlbsFi6dx2RXjuHSwD2ZGE9RoKs0Rdw_R-iFZYNlQhLI_1L8kAsNT9zgLS2ggWur5AvuhEXFMSEICdPE44y32YVk Jun 07 09:38:30.369495 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Domain-Id: None Jun 07 09:38:30.369495 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Domain-Name: None Jun 07 09:38:30.369495 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Identity-Status: Confirmed Jun 07 09:38:30.369495 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Is-Admin-Project: True Jun 07 09:38:30.369495 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Domain-Id: default Jun 07 09:38:30.369495 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Domain-Name: Default Jun 07 09:38:30.369495 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Id: 50189b9cf3b145ba84495af8db63c41b Jun 07 09:38:30.369495 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Name: tempest-AttachVolumeNegativeTest-238843557 Jun 07 09:38:30.369495 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Role: reader,member Jun 07 09:38:30.369495 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Roles: reader,member Jun 07 09:38:30.371255 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/50189b9cf3b145ba84495af8db63c41b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/50189b9cf3b145ba84495af8db63c41b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_50189b9cf3b145ba84495af8db63c41b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/50189b9cf3b145ba84495af8db63c41b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 07 09:38:30.371255 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Tenant: tempest-AttachVolumeNegativeTest-238843557 Jun 07 09:38:30.371255 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Tenant-Id: 50189b9cf3b145ba84495af8db63c41b Jun 07 09:38:30.371255 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-238843557 Jun 07 09:38:30.371255 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User: tempest-AttachVolumeNegativeTest-238843557-project Jun 07 09:38:30.371255 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Domain-Id: default Jun 07 09:38:30.371255 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Domain-Name: Default Jun 07 09:38:30.371255 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Id: 2f32356bb0bd4234ba817db581b62aad Jun 07 09:38:30.371255 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Name: tempest-AttachVolumeNegativeTest-238843557-project Jun 07 09:38:30.371255 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: method: > Jun 07 09:38:30.371255 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: exception: Instance 99a619a0-6d18-47e7-bbdf-811c2949405d could not be found. Jun 07 09:38:30.371255 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: action_args: {'id': '99a619a0-6d18-47e7-bbdf-811c2949405d'} Jun 07 09:38:30.372292 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 09:38:30.372292 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:38:30.372292 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 09:38:30.372292 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 09:38:30.372292 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 09:38:30.372292 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 09:38:30.372292 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 09:38:30.372292 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 09:38:30.372292 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 09:38:30.372292 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 09:38:30.372292 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99a619a0-6d18-47e7-bbdf-811c2949405d could not be found. Jun 07 09:38:30.372292 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:38:30.372292 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:38:30.372292 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:38:30.372292 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:38:30.372292 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:38:30.372292 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:38:30.372292 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 09:38:30.372292 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 09:38:30.372292 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 09:38:30.374180 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 09:38:30.374180 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 07 09:38:30.374180 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 07 09:38:30.374180 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 07 09:38:30.374180 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 07 09:38:30.374180 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 09:38:30.374180 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 09:38:30.374180 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 09:38:30.374180 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 09:38:30.374180 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99a619a0-6d18-47e7-bbdf-811c2949405d could not be found. Jun 07 09:38:30.374180 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:38:30.374180 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:38:30.374180 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:38:30.374180 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:38:30.374180 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:38:30.374180 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:38:30.374180 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 09:38:30.374180 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 09:38:30.374180 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99a619a0-6d18-47e7-bbdf-811c2949405d could not be found. Jun 07 09:38:30.374180 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:38:30.375950 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-3588bae7-3c2d-4fd9-9079-646960e20d9a tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Returning 404 to user: Instance 99a619a0-6d18-47e7-bbdf-811c2949405d could not be found. {{(pid=118740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 09:38:30.375950 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-3588bae7-3c2d-4fd9-9079-646960e20d9a tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "DELETE /compute/v2.1/servers/99a619a0-6d18-47e7-bbdf-811c2949405d" status: 404 len: 111 microversion: 2.1 time: 0.030936 Jun 07 09:38:30.375950 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 517/1033] 10.222.0.57 () {58 vars in 1238 bytes} [Tue Jun 7 09:38:30 2022] DELETE /compute/v2.1/servers/99a619a0-6d18-47e7-bbdf-811c2949405d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 09:38:30.380975 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-da2e7a94-ab49-43a5-9c94-80702ee7a028 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:38:30.381649 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-da2e7a94-ab49-43a5-9c94-80702ee7a028 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 99a619a0-6d18-47e7-bbdf-811c2949405d] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:38:30.388977 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-da2e7a94-ab49-43a5-9c94-80702ee7a028 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:38:30.389415 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-da2e7a94-ab49-43a5-9c94-80702ee7a028 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:38:30.390284 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-da2e7a94-ab49-43a5-9c94-80702ee7a028 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:38:30.390719 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-da2e7a94-ab49-43a5-9c94-80702ee7a028 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:38:30.404422 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.wsgi [None req-da2e7a94-ab49-43a5-9c94-80702ee7a028 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] HTTP exception thrown: Instance 99a619a0-6d18-47e7-bbdf-811c2949405d could not be found. Jun 07 09:38:30.406081 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-da2e7a94-ab49-43a5-9c94-80702ee7a028 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Request method failure captured: Jun 07 09:38:30.406081 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: request: GET /compute/v2.1/servers/99a619a0-6d18-47e7-bbdf-811c2949405d HTTP/1.1 Jun 07 09:38:30.406081 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Accept: application/json Jun 07 09:38:30.406081 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Accept-Encoding: identity Jun 07 09:38:30.406081 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Connection: close Jun 07 09:38:30.406081 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Content-Length: 0 Jun 07 09:38:30.406081 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Content-Type: application/json Jun 07 09:38:30.406081 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Host: 10.222.0.57 Jun 07 09:38:30.406081 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Openstack-System-Scope: None Jun 07 09:38:30.406081 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: User-Agent: python-urllib3/1.26.9 Jun 07 09:38:30.406081 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Auth-Token: gAAAAABinxpC12ZwKTW7QgnAffZ7E-ugoEXrTCPY3mQwE3_vl9PU9oHTK85PZ0XjIngREK5HYB-lK6ouZq5luxAqHs--1L8FlbsFi6dx2RXjuHSwD2ZGE9RoKs0Rdw_R-iFZYNlQhLI_1L8kAsNT9zgLS2ggWur5AvuhEXFMSEICdPE44y32YVk Jun 07 09:38:30.406081 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Domain-Id: None Jun 07 09:38:30.406081 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Domain-Name: None Jun 07 09:38:30.406081 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Identity-Status: Confirmed Jun 07 09:38:30.406081 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Is-Admin-Project: True Jun 07 09:38:30.406081 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Project-Domain-Id: default Jun 07 09:38:30.406081 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Project-Domain-Name: Default Jun 07 09:38:30.406081 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Project-Id: 50189b9cf3b145ba84495af8db63c41b Jun 07 09:38:30.406081 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Project-Name: tempest-AttachVolumeNegativeTest-238843557 Jun 07 09:38:30.406081 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Role: reader,member Jun 07 09:38:30.406081 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Roles: reader,member Jun 07 09:38:30.407692 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/50189b9cf3b145ba84495af8db63c41b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/50189b9cf3b145ba84495af8db63c41b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_50189b9cf3b145ba84495af8db63c41b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/50189b9cf3b145ba84495af8db63c41b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 07 09:38:30.407692 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Tenant: tempest-AttachVolumeNegativeTest-238843557 Jun 07 09:38:30.407692 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Tenant-Id: 50189b9cf3b145ba84495af8db63c41b Jun 07 09:38:30.407692 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-238843557 Jun 07 09:38:30.407692 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User: tempest-AttachVolumeNegativeTest-238843557-project Jun 07 09:38:30.407692 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User-Domain-Id: default Jun 07 09:38:30.407692 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User-Domain-Name: Default Jun 07 09:38:30.407692 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User-Id: 2f32356bb0bd4234ba817db581b62aad Jun 07 09:38:30.407692 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User-Name: tempest-AttachVolumeNegativeTest-238843557-project Jun 07 09:38:30.407692 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: method: > Jun 07 09:38:30.407692 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: exception: Instance 99a619a0-6d18-47e7-bbdf-811c2949405d could not be found. Jun 07 09:38:30.407692 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: action_args: {'id': '99a619a0-6d18-47e7-bbdf-811c2949405d'} Jun 07 09:38:30.408620 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 09:38:30.408620 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:38:30.408620 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 09:38:30.408620 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 09:38:30.408620 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 09:38:30.408620 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 09:38:30.408620 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 09:38:30.408620 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 09:38:30.408620 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 09:38:30.408620 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 09:38:30.408620 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99a619a0-6d18-47e7-bbdf-811c2949405d could not be found. Jun 07 09:38:30.408620 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:38:30.408620 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:38:30.408620 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:38:30.408620 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:38:30.408620 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:38:30.408620 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:38:30.408620 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 09:38:30.408620 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 09:38:30.408620 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 09:38:30.410307 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 09:38:30.410307 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 09:38:30.410307 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 09:38:30.410307 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 09:38:30.410307 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 09:38:30.410307 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 09:38:30.410307 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 09:38:30.410307 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99a619a0-6d18-47e7-bbdf-811c2949405d could not be found. Jun 07 09:38:30.410307 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:38:30.410307 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:38:30.410307 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:38:30.410307 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:38:30.410307 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:38:30.410307 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:38:30.410307 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 09:38:30.410307 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 09:38:30.410307 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99a619a0-6d18-47e7-bbdf-811c2949405d could not be found. Jun 07 09:38:30.410307 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:38:30.411862 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-da2e7a94-ab49-43a5-9c94-80702ee7a028 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Returning 404 to user: Instance 99a619a0-6d18-47e7-bbdf-811c2949405d could not be found. {{(pid=118741) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 09:38:30.411862 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-da2e7a94-ab49-43a5-9c94-80702ee7a028 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/99a619a0-6d18-47e7-bbdf-811c2949405d" status: 404 len: 111 microversion: 2.1 time: 0.030839 Jun 07 09:38:30.411862 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 517/1034] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:38:30 2022] GET /compute/v2.1/servers/99a619a0-6d18-47e7-bbdf-811c2949405d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 07 09:38:40.064411 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-ddbcc0e5-335f-42bf-92dd-e836b191e74b tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:38:40.065785 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-ddbcc0e5-335f-42bf-92dd-e836b191e74b tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 91b69fc3-c7b5-4243-8ee9-47e76d278c8b] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:38:40.072525 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-ddbcc0e5-335f-42bf-92dd-e836b191e74b tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:38:40.073034 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-ddbcc0e5-335f-42bf-92dd-e836b191e74b tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:38:40.073806 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-ddbcc0e5-335f-42bf-92dd-e836b191e74b tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:38:40.074252 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-ddbcc0e5-335f-42bf-92dd-e836b191e74b tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:38:40.090331 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.wsgi [None req-ddbcc0e5-335f-42bf-92dd-e836b191e74b tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] HTTP exception thrown: Instance 91b69fc3-c7b5-4243-8ee9-47e76d278c8b could not be found. Jun 07 09:38:40.091855 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-ddbcc0e5-335f-42bf-92dd-e836b191e74b tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Request method failure captured: Jun 07 09:38:40.091855 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: request: DELETE /compute/v2.1/servers/91b69fc3-c7b5-4243-8ee9-47e76d278c8b HTTP/1.1 Jun 07 09:38:40.091855 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Accept: application/json Jun 07 09:38:40.091855 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Accept-Encoding: identity Jun 07 09:38:40.091855 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Connection: close Jun 07 09:38:40.091855 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Content-Length: 0 Jun 07 09:38:40.091855 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Content-Type: application/json Jun 07 09:38:40.091855 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Host: 10.222.0.57 Jun 07 09:38:40.091855 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Openstack-System-Scope: None Jun 07 09:38:40.091855 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: User-Agent: python-urllib3/1.26.9 Jun 07 09:38:40.091855 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Auth-Token: gAAAAABinxpC12ZwKTW7QgnAffZ7E-ugoEXrTCPY3mQwE3_vl9PU9oHTK85PZ0XjIngREK5HYB-lK6ouZq5luxAqHs--1L8FlbsFi6dx2RXjuHSwD2ZGE9RoKs0Rdw_R-iFZYNlQhLI_1L8kAsNT9zgLS2ggWur5AvuhEXFMSEICdPE44y32YVk Jun 07 09:38:40.091855 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Domain-Id: None Jun 07 09:38:40.091855 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Domain-Name: None Jun 07 09:38:40.091855 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Identity-Status: Confirmed Jun 07 09:38:40.091855 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Is-Admin-Project: True Jun 07 09:38:40.091855 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Domain-Id: default Jun 07 09:38:40.091855 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Domain-Name: Default Jun 07 09:38:40.091855 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Id: 50189b9cf3b145ba84495af8db63c41b Jun 07 09:38:40.091855 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Name: tempest-AttachVolumeNegativeTest-238843557 Jun 07 09:38:40.091855 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Role: reader,member Jun 07 09:38:40.091855 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Roles: reader,member Jun 07 09:38:40.093587 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/50189b9cf3b145ba84495af8db63c41b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/50189b9cf3b145ba84495af8db63c41b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_50189b9cf3b145ba84495af8db63c41b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/50189b9cf3b145ba84495af8db63c41b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 07 09:38:40.093587 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Tenant: tempest-AttachVolumeNegativeTest-238843557 Jun 07 09:38:40.093587 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Tenant-Id: 50189b9cf3b145ba84495af8db63c41b Jun 07 09:38:40.093587 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-238843557 Jun 07 09:38:40.093587 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User: tempest-AttachVolumeNegativeTest-238843557-project Jun 07 09:38:40.093587 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Domain-Id: default Jun 07 09:38:40.093587 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Domain-Name: Default Jun 07 09:38:40.093587 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Id: 2f32356bb0bd4234ba817db581b62aad Jun 07 09:38:40.093587 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Name: tempest-AttachVolumeNegativeTest-238843557-project Jun 07 09:38:40.093587 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: method: > Jun 07 09:38:40.093587 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: exception: Instance 91b69fc3-c7b5-4243-8ee9-47e76d278c8b could not be found. Jun 07 09:38:40.093587 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: action_args: {'id': '91b69fc3-c7b5-4243-8ee9-47e76d278c8b'} Jun 07 09:38:40.094478 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 09:38:40.094478 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:38:40.094478 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 09:38:40.094478 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 09:38:40.094478 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 09:38:40.094478 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 09:38:40.094478 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 09:38:40.094478 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 09:38:40.094478 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 09:38:40.094478 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 09:38:40.094478 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91b69fc3-c7b5-4243-8ee9-47e76d278c8b could not be found. Jun 07 09:38:40.094478 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:38:40.094478 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:38:40.094478 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:38:40.094478 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:38:40.094478 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:38:40.094478 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:38:40.094478 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 09:38:40.094478 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 09:38:40.094478 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 09:38:40.095934 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 09:38:40.095934 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 07 09:38:40.095934 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 07 09:38:40.095934 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 07 09:38:40.095934 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 07 09:38:40.095934 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 09:38:40.095934 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 09:38:40.095934 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 09:38:40.095934 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 09:38:40.095934 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91b69fc3-c7b5-4243-8ee9-47e76d278c8b could not be found. Jun 07 09:38:40.095934 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:38:40.095934 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:38:40.095934 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:38:40.095934 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:38:40.095934 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:38:40.095934 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:38:40.095934 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 09:38:40.095934 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 09:38:40.095934 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91b69fc3-c7b5-4243-8ee9-47e76d278c8b could not be found. Jun 07 09:38:40.095934 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:38:40.097506 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-ddbcc0e5-335f-42bf-92dd-e836b191e74b tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Returning 404 to user: Instance 91b69fc3-c7b5-4243-8ee9-47e76d278c8b could not be found. {{(pid=118740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 09:38:40.097506 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-ddbcc0e5-335f-42bf-92dd-e836b191e74b tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "DELETE /compute/v2.1/servers/91b69fc3-c7b5-4243-8ee9-47e76d278c8b" status: 404 len: 111 microversion: 2.1 time: 0.032866 Jun 07 09:38:40.097506 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 518/1035] 10.222.0.57 () {58 vars in 1238 bytes} [Tue Jun 7 09:38:40 2022] DELETE /compute/v2.1/servers/91b69fc3-c7b5-4243-8ee9-47e76d278c8b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 09:38:40.106169 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-bdff2516-ccdc-4c21-b5b7-e219742b4e00 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:38:40.108911 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-bdff2516-ccdc-4c21-b5b7-e219742b4e00 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 91b69fc3-c7b5-4243-8ee9-47e76d278c8b] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:38:40.113497 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-bdff2516-ccdc-4c21-b5b7-e219742b4e00 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:38:40.113949 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-bdff2516-ccdc-4c21-b5b7-e219742b4e00 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:38:40.114704 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-bdff2516-ccdc-4c21-b5b7-e219742b4e00 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:38:40.115202 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-bdff2516-ccdc-4c21-b5b7-e219742b4e00 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:38:40.128691 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.wsgi [None req-bdff2516-ccdc-4c21-b5b7-e219742b4e00 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] HTTP exception thrown: Instance 91b69fc3-c7b5-4243-8ee9-47e76d278c8b could not be found. Jun 07 09:38:40.130198 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-bdff2516-ccdc-4c21-b5b7-e219742b4e00 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Request method failure captured: Jun 07 09:38:40.130198 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: request: GET /compute/v2.1/servers/91b69fc3-c7b5-4243-8ee9-47e76d278c8b HTTP/1.1 Jun 07 09:38:40.130198 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Accept: application/json Jun 07 09:38:40.130198 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Accept-Encoding: identity Jun 07 09:38:40.130198 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Connection: close Jun 07 09:38:40.130198 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Content-Length: 0 Jun 07 09:38:40.130198 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Content-Type: application/json Jun 07 09:38:40.130198 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Host: 10.222.0.57 Jun 07 09:38:40.130198 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Openstack-System-Scope: None Jun 07 09:38:40.130198 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: User-Agent: python-urllib3/1.26.9 Jun 07 09:38:40.130198 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Auth-Token: gAAAAABinxpC12ZwKTW7QgnAffZ7E-ugoEXrTCPY3mQwE3_vl9PU9oHTK85PZ0XjIngREK5HYB-lK6ouZq5luxAqHs--1L8FlbsFi6dx2RXjuHSwD2ZGE9RoKs0Rdw_R-iFZYNlQhLI_1L8kAsNT9zgLS2ggWur5AvuhEXFMSEICdPE44y32YVk Jun 07 09:38:40.130198 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Domain-Id: None Jun 07 09:38:40.130198 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Domain-Name: None Jun 07 09:38:40.130198 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Identity-Status: Confirmed Jun 07 09:38:40.130198 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Is-Admin-Project: True Jun 07 09:38:40.130198 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Project-Domain-Id: default Jun 07 09:38:40.130198 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Project-Domain-Name: Default Jun 07 09:38:40.130198 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Project-Id: 50189b9cf3b145ba84495af8db63c41b Jun 07 09:38:40.130198 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Project-Name: tempest-AttachVolumeNegativeTest-238843557 Jun 07 09:38:40.130198 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Role: reader,member Jun 07 09:38:40.130198 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Roles: reader,member Jun 07 09:38:40.132739 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/50189b9cf3b145ba84495af8db63c41b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/50189b9cf3b145ba84495af8db63c41b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_50189b9cf3b145ba84495af8db63c41b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/50189b9cf3b145ba84495af8db63c41b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 07 09:38:40.132739 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Tenant: tempest-AttachVolumeNegativeTest-238843557 Jun 07 09:38:40.132739 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Tenant-Id: 50189b9cf3b145ba84495af8db63c41b Jun 07 09:38:40.132739 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-238843557 Jun 07 09:38:40.132739 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User: tempest-AttachVolumeNegativeTest-238843557-project Jun 07 09:38:40.132739 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User-Domain-Id: default Jun 07 09:38:40.132739 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User-Domain-Name: Default Jun 07 09:38:40.132739 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User-Id: 2f32356bb0bd4234ba817db581b62aad Jun 07 09:38:40.132739 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User-Name: tempest-AttachVolumeNegativeTest-238843557-project Jun 07 09:38:40.132739 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: method: > Jun 07 09:38:40.132739 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: exception: Instance 91b69fc3-c7b5-4243-8ee9-47e76d278c8b could not be found. Jun 07 09:38:40.132739 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: action_args: {'id': '91b69fc3-c7b5-4243-8ee9-47e76d278c8b'} Jun 07 09:38:40.133672 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 09:38:40.133672 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:38:40.133672 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 09:38:40.133672 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 09:38:40.133672 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 09:38:40.133672 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 09:38:40.133672 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 09:38:40.133672 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 09:38:40.133672 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 09:38:40.133672 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 09:38:40.133672 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91b69fc3-c7b5-4243-8ee9-47e76d278c8b could not be found. Jun 07 09:38:40.133672 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:38:40.133672 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:38:40.133672 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:38:40.133672 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:38:40.133672 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:38:40.133672 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:38:40.133672 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 09:38:40.133672 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 09:38:40.133672 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 09:38:40.135235 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 09:38:40.135235 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 09:38:40.135235 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 09:38:40.135235 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 09:38:40.135235 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 09:38:40.135235 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 09:38:40.135235 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 09:38:40.135235 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91b69fc3-c7b5-4243-8ee9-47e76d278c8b could not be found. Jun 07 09:38:40.135235 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:38:40.135235 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:38:40.135235 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:38:40.135235 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:38:40.135235 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:38:40.135235 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:38:40.135235 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 09:38:40.135235 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 09:38:40.135235 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91b69fc3-c7b5-4243-8ee9-47e76d278c8b could not be found. Jun 07 09:38:40.135235 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:38:40.136527 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-bdff2516-ccdc-4c21-b5b7-e219742b4e00 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Returning 404 to user: Instance 91b69fc3-c7b5-4243-8ee9-47e76d278c8b could not be found. {{(pid=118741) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 09:38:40.136527 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-bdff2516-ccdc-4c21-b5b7-e219742b4e00 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/91b69fc3-c7b5-4243-8ee9-47e76d278c8b" status: 404 len: 111 microversion: 2.1 time: 0.029259 Jun 07 09:38:40.136527 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 518/1036] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:38:40 2022] GET /compute/v2.1/servers/91b69fc3-c7b5-4243-8ee9-47e76d278c8b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 09:38:40.140088 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-071acd6d-a183-4760-9e50-1d4c30c16997 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:38:40.140610 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-071acd6d-a183-4760-9e50-1d4c30c16997 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 0aeeca04-2158-46a0-aabc-80438e18044d] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:38:40.147207 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-071acd6d-a183-4760-9e50-1d4c30c16997 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:38:40.147654 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-071acd6d-a183-4760-9e50-1d4c30c16997 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:38:40.148411 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-071acd6d-a183-4760-9e50-1d4c30c16997 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:38:40.148874 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-071acd6d-a183-4760-9e50-1d4c30c16997 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:38:40.162207 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.wsgi [None req-071acd6d-a183-4760-9e50-1d4c30c16997 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] HTTP exception thrown: Instance 0aeeca04-2158-46a0-aabc-80438e18044d could not be found. Jun 07 09:38:40.163647 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-071acd6d-a183-4760-9e50-1d4c30c16997 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Request method failure captured: Jun 07 09:38:40.163647 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: request: DELETE /compute/v2.1/servers/0aeeca04-2158-46a0-aabc-80438e18044d HTTP/1.1 Jun 07 09:38:40.163647 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Accept: application/json Jun 07 09:38:40.163647 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Accept-Encoding: identity Jun 07 09:38:40.163647 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Connection: close Jun 07 09:38:40.163647 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Content-Length: 0 Jun 07 09:38:40.163647 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Content-Type: application/json Jun 07 09:38:40.163647 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Host: 10.222.0.57 Jun 07 09:38:40.163647 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Openstack-System-Scope: None Jun 07 09:38:40.163647 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: User-Agent: python-urllib3/1.26.9 Jun 07 09:38:40.163647 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Auth-Token: gAAAAABinxpC12ZwKTW7QgnAffZ7E-ugoEXrTCPY3mQwE3_vl9PU9oHTK85PZ0XjIngREK5HYB-lK6ouZq5luxAqHs--1L8FlbsFi6dx2RXjuHSwD2ZGE9RoKs0Rdw_R-iFZYNlQhLI_1L8kAsNT9zgLS2ggWur5AvuhEXFMSEICdPE44y32YVk Jun 07 09:38:40.163647 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Domain-Id: None Jun 07 09:38:40.163647 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Domain-Name: None Jun 07 09:38:40.163647 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Identity-Status: Confirmed Jun 07 09:38:40.163647 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Is-Admin-Project: True Jun 07 09:38:40.163647 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Domain-Id: default Jun 07 09:38:40.163647 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Domain-Name: Default Jun 07 09:38:40.163647 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Id: 50189b9cf3b145ba84495af8db63c41b Jun 07 09:38:40.163647 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Name: tempest-AttachVolumeNegativeTest-238843557 Jun 07 09:38:40.163647 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Role: reader,member Jun 07 09:38:40.163647 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Roles: reader,member Jun 07 09:38:40.165241 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/50189b9cf3b145ba84495af8db63c41b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/50189b9cf3b145ba84495af8db63c41b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_50189b9cf3b145ba84495af8db63c41b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/50189b9cf3b145ba84495af8db63c41b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 07 09:38:40.165241 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Tenant: tempest-AttachVolumeNegativeTest-238843557 Jun 07 09:38:40.165241 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Tenant-Id: 50189b9cf3b145ba84495af8db63c41b Jun 07 09:38:40.165241 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-238843557 Jun 07 09:38:40.165241 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User: tempest-AttachVolumeNegativeTest-238843557-project Jun 07 09:38:40.165241 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Domain-Id: default Jun 07 09:38:40.165241 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Domain-Name: Default Jun 07 09:38:40.165241 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Id: 2f32356bb0bd4234ba817db581b62aad Jun 07 09:38:40.165241 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Name: tempest-AttachVolumeNegativeTest-238843557-project Jun 07 09:38:40.165241 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: method: > Jun 07 09:38:40.165241 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: exception: Instance 0aeeca04-2158-46a0-aabc-80438e18044d could not be found. Jun 07 09:38:40.165241 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: action_args: {'id': '0aeeca04-2158-46a0-aabc-80438e18044d'} Jun 07 09:38:40.166109 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 09:38:40.166109 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:38:40.166109 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 09:38:40.166109 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 09:38:40.166109 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 09:38:40.166109 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 09:38:40.166109 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 09:38:40.166109 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 09:38:40.166109 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 09:38:40.166109 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 09:38:40.166109 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0aeeca04-2158-46a0-aabc-80438e18044d could not be found. Jun 07 09:38:40.166109 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:38:40.166109 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:38:40.166109 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:38:40.166109 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:38:40.166109 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:38:40.166109 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:38:40.166109 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 09:38:40.166109 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 09:38:40.166109 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 09:38:40.167384 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 09:38:40.167384 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 07 09:38:40.167384 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 07 09:38:40.167384 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 07 09:38:40.167384 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 07 09:38:40.167384 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 09:38:40.167384 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 09:38:40.167384 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 09:38:40.167384 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 09:38:40.167384 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0aeeca04-2158-46a0-aabc-80438e18044d could not be found. Jun 07 09:38:40.167384 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:38:40.167384 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:38:40.167384 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:38:40.167384 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:38:40.167384 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:38:40.167384 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:38:40.167384 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 09:38:40.167384 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 09:38:40.167384 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0aeeca04-2158-46a0-aabc-80438e18044d could not be found. Jun 07 09:38:40.167384 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:38:40.168605 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-071acd6d-a183-4760-9e50-1d4c30c16997 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Returning 404 to user: Instance 0aeeca04-2158-46a0-aabc-80438e18044d could not be found. {{(pid=118740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 09:38:40.168605 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-071acd6d-a183-4760-9e50-1d4c30c16997 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "DELETE /compute/v2.1/servers/0aeeca04-2158-46a0-aabc-80438e18044d" status: 404 len: 111 microversion: 2.1 time: 0.028770 Jun 07 09:38:40.168605 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 519/1037] 10.222.0.57 () {58 vars in 1238 bytes} [Tue Jun 7 09:38:40 2022] DELETE /compute/v2.1/servers/0aeeca04-2158-46a0-aabc-80438e18044d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 07 09:38:40.173353 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-b8bc5a88-b177-494a-8343-52300ef57e06 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:38:40.173997 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-b8bc5a88-b177-494a-8343-52300ef57e06 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 0aeeca04-2158-46a0-aabc-80438e18044d] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:38:40.180075 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b8bc5a88-b177-494a-8343-52300ef57e06 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:38:40.180532 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b8bc5a88-b177-494a-8343-52300ef57e06 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:38:40.181325 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b8bc5a88-b177-494a-8343-52300ef57e06 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:38:40.181767 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b8bc5a88-b177-494a-8343-52300ef57e06 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:38:40.197182 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.wsgi [None req-b8bc5a88-b177-494a-8343-52300ef57e06 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] HTTP exception thrown: Instance 0aeeca04-2158-46a0-aabc-80438e18044d could not be found. Jun 07 09:38:40.198708 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-b8bc5a88-b177-494a-8343-52300ef57e06 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Request method failure captured: Jun 07 09:38:40.198708 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: request: GET /compute/v2.1/servers/0aeeca04-2158-46a0-aabc-80438e18044d HTTP/1.1 Jun 07 09:38:40.198708 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Accept: application/json Jun 07 09:38:40.198708 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Accept-Encoding: identity Jun 07 09:38:40.198708 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Connection: close Jun 07 09:38:40.198708 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Content-Length: 0 Jun 07 09:38:40.198708 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Content-Type: application/json Jun 07 09:38:40.198708 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Host: 10.222.0.57 Jun 07 09:38:40.198708 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Openstack-System-Scope: None Jun 07 09:38:40.198708 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: User-Agent: python-urllib3/1.26.9 Jun 07 09:38:40.198708 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Auth-Token: gAAAAABinxpC12ZwKTW7QgnAffZ7E-ugoEXrTCPY3mQwE3_vl9PU9oHTK85PZ0XjIngREK5HYB-lK6ouZq5luxAqHs--1L8FlbsFi6dx2RXjuHSwD2ZGE9RoKs0Rdw_R-iFZYNlQhLI_1L8kAsNT9zgLS2ggWur5AvuhEXFMSEICdPE44y32YVk Jun 07 09:38:40.198708 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Domain-Id: None Jun 07 09:38:40.198708 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Domain-Name: None Jun 07 09:38:40.198708 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Identity-Status: Confirmed Jun 07 09:38:40.198708 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Is-Admin-Project: True Jun 07 09:38:40.198708 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Project-Domain-Id: default Jun 07 09:38:40.198708 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Project-Domain-Name: Default Jun 07 09:38:40.198708 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Project-Id: 50189b9cf3b145ba84495af8db63c41b Jun 07 09:38:40.198708 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Project-Name: tempest-AttachVolumeNegativeTest-238843557 Jun 07 09:38:40.198708 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Role: reader,member Jun 07 09:38:40.198708 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Roles: reader,member Jun 07 09:38:40.200252 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/50189b9cf3b145ba84495af8db63c41b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/50189b9cf3b145ba84495af8db63c41b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_50189b9cf3b145ba84495af8db63c41b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/50189b9cf3b145ba84495af8db63c41b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 07 09:38:40.200252 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Tenant: tempest-AttachVolumeNegativeTest-238843557 Jun 07 09:38:40.200252 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Tenant-Id: 50189b9cf3b145ba84495af8db63c41b Jun 07 09:38:40.200252 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-238843557 Jun 07 09:38:40.200252 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User: tempest-AttachVolumeNegativeTest-238843557-project Jun 07 09:38:40.200252 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User-Domain-Id: default Jun 07 09:38:40.200252 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User-Domain-Name: Default Jun 07 09:38:40.200252 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User-Id: 2f32356bb0bd4234ba817db581b62aad Jun 07 09:38:40.200252 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User-Name: tempest-AttachVolumeNegativeTest-238843557-project Jun 07 09:38:40.200252 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: method: > Jun 07 09:38:40.200252 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: exception: Instance 0aeeca04-2158-46a0-aabc-80438e18044d could not be found. Jun 07 09:38:40.200252 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: action_args: {'id': '0aeeca04-2158-46a0-aabc-80438e18044d'} Jun 07 09:38:40.201200 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 09:38:40.201200 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:38:40.201200 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 09:38:40.201200 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 09:38:40.201200 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 09:38:40.201200 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 09:38:40.201200 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 09:38:40.201200 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 09:38:40.201200 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 09:38:40.201200 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 09:38:40.201200 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0aeeca04-2158-46a0-aabc-80438e18044d could not be found. Jun 07 09:38:40.201200 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:38:40.201200 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:38:40.201200 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:38:40.201200 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:38:40.201200 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:38:40.201200 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:38:40.201200 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 09:38:40.201200 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 09:38:40.201200 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 09:38:40.202739 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 09:38:40.202739 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 09:38:40.202739 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 09:38:40.202739 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 09:38:40.202739 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 09:38:40.202739 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 09:38:40.202739 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 09:38:40.202739 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0aeeca04-2158-46a0-aabc-80438e18044d could not be found. Jun 07 09:38:40.202739 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:38:40.202739 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:38:40.202739 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:38:40.202739 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:38:40.202739 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:38:40.202739 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:38:40.202739 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 09:38:40.202739 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 09:38:40.202739 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0aeeca04-2158-46a0-aabc-80438e18044d could not be found. Jun 07 09:38:40.202739 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:38:40.204291 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-b8bc5a88-b177-494a-8343-52300ef57e06 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Returning 404 to user: Instance 0aeeca04-2158-46a0-aabc-80438e18044d could not be found. {{(pid=118741) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 09:38:40.204291 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-b8bc5a88-b177-494a-8343-52300ef57e06 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/0aeeca04-2158-46a0-aabc-80438e18044d" status: 404 len: 111 microversion: 2.1 time: 0.030655 Jun 07 09:38:40.204291 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 519/1038] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:38:40 2022] GET /compute/v2.1/servers/0aeeca04-2158-46a0-aabc-80438e18044d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 07 09:38:41.458421 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-ba6ac694-8c99-40f3-9205-94a85a749848 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:38:41.458961 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-ba6ac694-8c99-40f3-9205-94a85a749848 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 0e41026b-9a96-47df-a158-d8ea485025bd] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:38:41.465493 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-ba6ac694-8c99-40f3-9205-94a85a749848 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:38:41.465940 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-ba6ac694-8c99-40f3-9205-94a85a749848 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:38:41.466692 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-ba6ac694-8c99-40f3-9205-94a85a749848 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:38:41.467255 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-ba6ac694-8c99-40f3-9205-94a85a749848 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:38:41.481521 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.wsgi [None req-ba6ac694-8c99-40f3-9205-94a85a749848 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] HTTP exception thrown: Instance 0e41026b-9a96-47df-a158-d8ea485025bd could not be found. Jun 07 09:38:41.483076 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-ba6ac694-8c99-40f3-9205-94a85a749848 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Request method failure captured: Jun 07 09:38:41.483076 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: request: DELETE /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd HTTP/1.1 Jun 07 09:38:41.483076 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Accept: application/json Jun 07 09:38:41.483076 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Accept-Encoding: identity Jun 07 09:38:41.483076 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Connection: close Jun 07 09:38:41.483076 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Content-Length: 0 Jun 07 09:38:41.483076 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Content-Type: application/json Jun 07 09:38:41.483076 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Host: 10.222.0.57 Jun 07 09:38:41.483076 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Openstack-System-Scope: None Jun 07 09:38:41.483076 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: User-Agent: python-urllib3/1.26.9 Jun 07 09:38:41.483076 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Auth-Token: gAAAAABinxpC12ZwKTW7QgnAffZ7E-ugoEXrTCPY3mQwE3_vl9PU9oHTK85PZ0XjIngREK5HYB-lK6ouZq5luxAqHs--1L8FlbsFi6dx2RXjuHSwD2ZGE9RoKs0Rdw_R-iFZYNlQhLI_1L8kAsNT9zgLS2ggWur5AvuhEXFMSEICdPE44y32YVk Jun 07 09:38:41.483076 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Domain-Id: None Jun 07 09:38:41.483076 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Domain-Name: None Jun 07 09:38:41.483076 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Identity-Status: Confirmed Jun 07 09:38:41.483076 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Is-Admin-Project: True Jun 07 09:38:41.483076 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Domain-Id: default Jun 07 09:38:41.483076 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Domain-Name: Default Jun 07 09:38:41.483076 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Id: 50189b9cf3b145ba84495af8db63c41b Jun 07 09:38:41.483076 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Name: tempest-AttachVolumeNegativeTest-238843557 Jun 07 09:38:41.483076 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Role: reader,member Jun 07 09:38:41.483076 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Roles: reader,member Jun 07 09:38:41.484751 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/50189b9cf3b145ba84495af8db63c41b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/50189b9cf3b145ba84495af8db63c41b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_50189b9cf3b145ba84495af8db63c41b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/50189b9cf3b145ba84495af8db63c41b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 07 09:38:41.484751 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Tenant: tempest-AttachVolumeNegativeTest-238843557 Jun 07 09:38:41.484751 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Tenant-Id: 50189b9cf3b145ba84495af8db63c41b Jun 07 09:38:41.484751 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-238843557 Jun 07 09:38:41.484751 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User: tempest-AttachVolumeNegativeTest-238843557-project Jun 07 09:38:41.484751 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Domain-Id: default Jun 07 09:38:41.484751 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Domain-Name: Default Jun 07 09:38:41.484751 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Id: 2f32356bb0bd4234ba817db581b62aad Jun 07 09:38:41.484751 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Name: tempest-AttachVolumeNegativeTest-238843557-project Jun 07 09:38:41.484751 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: method: > Jun 07 09:38:41.484751 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: exception: Instance 0e41026b-9a96-47df-a158-d8ea485025bd could not be found. Jun 07 09:38:41.484751 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: action_args: {'id': '0e41026b-9a96-47df-a158-d8ea485025bd'} Jun 07 09:38:41.488567 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 09:38:41.488567 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:38:41.488567 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 09:38:41.488567 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 09:38:41.488567 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 09:38:41.488567 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 09:38:41.488567 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 09:38:41.488567 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 09:38:41.488567 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 09:38:41.488567 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 09:38:41.488567 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e41026b-9a96-47df-a158-d8ea485025bd could not be found. Jun 07 09:38:41.488567 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:38:41.488567 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:38:41.488567 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:38:41.488567 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:38:41.488567 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:38:41.488567 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:38:41.488567 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 09:38:41.488567 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 09:38:41.488567 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 09:38:41.490114 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 09:38:41.490114 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 07 09:38:41.490114 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 07 09:38:41.490114 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 07 09:38:41.490114 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 07 09:38:41.490114 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 09:38:41.490114 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 09:38:41.490114 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 09:38:41.490114 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 09:38:41.490114 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e41026b-9a96-47df-a158-d8ea485025bd could not be found. Jun 07 09:38:41.490114 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:38:41.490114 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:38:41.490114 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:38:41.490114 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:38:41.490114 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:38:41.490114 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:38:41.490114 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 09:38:41.490114 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 09:38:41.490114 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e41026b-9a96-47df-a158-d8ea485025bd could not be found. Jun 07 09:38:41.490114 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:38:41.491614 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-ba6ac694-8c99-40f3-9205-94a85a749848 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Returning 404 to user: Instance 0e41026b-9a96-47df-a158-d8ea485025bd could not be found. {{(pid=118740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 09:38:41.491614 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-ba6ac694-8c99-40f3-9205-94a85a749848 tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "DELETE /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd" status: 404 len: 111 microversion: 2.1 time: 0.029931 Jun 07 09:38:41.491614 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 520/1039] 10.222.0.57 () {58 vars in 1238 bytes} [Tue Jun 7 09:38:41 2022] DELETE /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 09:38:41.494047 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-e8b36052-c9f1-41a9-bce8-ad8a911a47fe tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:38:41.494666 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-e8b36052-c9f1-41a9-bce8-ad8a911a47fe tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] [instance: 0e41026b-9a96-47df-a158-d8ea485025bd] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:38:41.498253 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writing DB stats nova_api:SELECT=25,nova_api:DELETE=1 {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:38:41.501841 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-e8b36052-c9f1-41a9-bce8-ad8a911a47fe tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:38:41.502305 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-e8b36052-c9f1-41a9-bce8-ad8a911a47fe tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:38:41.503064 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-e8b36052-c9f1-41a9-bce8-ad8a911a47fe tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:38:41.503523 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-e8b36052-c9f1-41a9-bce8-ad8a911a47fe tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:38:41.507483 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:38:41.516892 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.wsgi [None req-e8b36052-c9f1-41a9-bce8-ad8a911a47fe tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] HTTP exception thrown: Instance 0e41026b-9a96-47df-a158-d8ea485025bd could not be found. Jun 07 09:38:41.518410 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-e8b36052-c9f1-41a9-bce8-ad8a911a47fe tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Request method failure captured: Jun 07 09:38:41.518410 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: request: GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd HTTP/1.1 Jun 07 09:38:41.518410 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Accept: application/json Jun 07 09:38:41.518410 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Accept-Encoding: identity Jun 07 09:38:41.518410 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Connection: close Jun 07 09:38:41.518410 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Content-Length: 0 Jun 07 09:38:41.518410 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Content-Type: application/json Jun 07 09:38:41.518410 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Host: 10.222.0.57 Jun 07 09:38:41.518410 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Openstack-System-Scope: None Jun 07 09:38:41.518410 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: User-Agent: python-urllib3/1.26.9 Jun 07 09:38:41.518410 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Auth-Token: gAAAAABinxpC12ZwKTW7QgnAffZ7E-ugoEXrTCPY3mQwE3_vl9PU9oHTK85PZ0XjIngREK5HYB-lK6ouZq5luxAqHs--1L8FlbsFi6dx2RXjuHSwD2ZGE9RoKs0Rdw_R-iFZYNlQhLI_1L8kAsNT9zgLS2ggWur5AvuhEXFMSEICdPE44y32YVk Jun 07 09:38:41.518410 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Domain-Id: None Jun 07 09:38:41.518410 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Domain-Name: None Jun 07 09:38:41.518410 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Identity-Status: Confirmed Jun 07 09:38:41.518410 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Is-Admin-Project: True Jun 07 09:38:41.518410 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Project-Domain-Id: default Jun 07 09:38:41.518410 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Project-Domain-Name: Default Jun 07 09:38:41.518410 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Project-Id: 50189b9cf3b145ba84495af8db63c41b Jun 07 09:38:41.518410 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Project-Name: tempest-AttachVolumeNegativeTest-238843557 Jun 07 09:38:41.518410 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Role: reader,member Jun 07 09:38:41.518410 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Roles: reader,member Jun 07 09:38:41.520001 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/50189b9cf3b145ba84495af8db63c41b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/50189b9cf3b145ba84495af8db63c41b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_50189b9cf3b145ba84495af8db63c41b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/50189b9cf3b145ba84495af8db63c41b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 07 09:38:41.520001 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Tenant: tempest-AttachVolumeNegativeTest-238843557 Jun 07 09:38:41.520001 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Tenant-Id: 50189b9cf3b145ba84495af8db63c41b Jun 07 09:38:41.520001 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-238843557 Jun 07 09:38:41.520001 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User: tempest-AttachVolumeNegativeTest-238843557-project Jun 07 09:38:41.520001 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User-Domain-Id: default Jun 07 09:38:41.520001 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User-Domain-Name: Default Jun 07 09:38:41.520001 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User-Id: 2f32356bb0bd4234ba817db581b62aad Jun 07 09:38:41.520001 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User-Name: tempest-AttachVolumeNegativeTest-238843557-project Jun 07 09:38:41.520001 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: method: > Jun 07 09:38:41.520001 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: exception: Instance 0e41026b-9a96-47df-a158-d8ea485025bd could not be found. Jun 07 09:38:41.520001 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: action_args: {'id': '0e41026b-9a96-47df-a158-d8ea485025bd'} Jun 07 09:38:41.520946 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 09:38:41.520946 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:38:41.520946 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 09:38:41.520946 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 09:38:41.520946 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 09:38:41.520946 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 09:38:41.520946 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 09:38:41.520946 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 09:38:41.520946 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 09:38:41.520946 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 09:38:41.520946 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e41026b-9a96-47df-a158-d8ea485025bd could not be found. Jun 07 09:38:41.520946 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:38:41.520946 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:38:41.520946 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:38:41.520946 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:38:41.520946 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:38:41.520946 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:38:41.520946 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 09:38:41.520946 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 09:38:41.520946 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 09:38:41.522600 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 09:38:41.522600 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 09:38:41.522600 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 09:38:41.522600 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 09:38:41.522600 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 09:38:41.522600 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 09:38:41.522600 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 09:38:41.522600 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e41026b-9a96-47df-a158-d8ea485025bd could not be found. Jun 07 09:38:41.522600 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:38:41.522600 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:38:41.522600 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:38:41.522600 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:38:41.522600 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:38:41.522600 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:38:41.522600 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 09:38:41.522600 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 09:38:41.522600 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e41026b-9a96-47df-a158-d8ea485025bd could not be found. Jun 07 09:38:41.522600 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:38:41.523903 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-e8b36052-c9f1-41a9-bce8-ad8a911a47fe tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] Returning 404 to user: Instance 0e41026b-9a96-47df-a158-d8ea485025bd could not be found. {{(pid=118741) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 09:38:41.523903 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-e8b36052-c9f1-41a9-bce8-ad8a911a47fe tempest-AttachVolumeNegativeTest-238843557 tempest-AttachVolumeNegativeTest-238843557-project] 10.222.0.57 "GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd" status: 404 len: 111 microversion: 2.1 time: 0.030138 Jun 07 09:38:41.523903 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 520/1040] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:38:41 2022] GET /compute/v2.1/servers/0e41026b-9a96-47df-a158-d8ea485025bd => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 09:38:55.607302 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-7d9cb3a7-b8b0-424c-af48-f89c81dde4a8 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:38:55.608235 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-7d9cb3a7-b8b0-424c-af48-f89c81dde4a8 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 3cc1496a-defc-48eb-8e12-4b328dd6fa31] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:38:55.610769 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:38:55.611424 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writing DB stats nova_cell1:SELECT=51,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:38:55.616221 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-7d9cb3a7-b8b0-424c-af48-f89c81dde4a8 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:38:55.616713 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-7d9cb3a7-b8b0-424c-af48-f89c81dde4a8 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:38:55.617563 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-7d9cb3a7-b8b0-424c-af48-f89c81dde4a8 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:38:55.618009 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-7d9cb3a7-b8b0-424c-af48-f89c81dde4a8 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:38:55.648926 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-7d9cb3a7-b8b0-424c-af48-f89c81dde4a8 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045526 Jun 07 09:38:55.649480 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 521/1041] 10.222.0.57 () {60 vars in 1342 bytes} [Tue Jun 7 09:38:55 2022] GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:38:55.709697 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-5315c8c6-6095-44c3-af21-071039c25d39 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:38:55.710206 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-5315c8c6-6095-44c3-af21-071039c25d39 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 3cc1496a-defc-48eb-8e12-4b328dd6fa31] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:38:55.717700 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-5315c8c6-6095-44c3-af21-071039c25d39 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:38:55.718153 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-5315c8c6-6095-44c3-af21-071039c25d39 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:38:55.718914 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-5315c8c6-6095-44c3-af21-071039c25d39 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:38:55.719354 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-5315c8c6-6095-44c3-af21-071039c25d39 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:38:55.744889 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-5315c8c6-6095-44c3-af21-071039c25d39 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 3cc1496a-defc-48eb-8e12-4b328dd6fa31] Going to try to terminate instance {{(pid=118741) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 09:38:56.107261 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-5315c8c6-6095-44c3-af21-071039c25d39 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "DELETE /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31" status: 204 len: 0 microversion: 2.20 time: 0.402248 Jun 07 09:38:56.107985 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 521/1042] 10.222.0.57 () {60 vars in 1279 bytes} [Tue Jun 7 09:38:55 2022] DELETE /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 07 09:38:56.117043 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-cd46ef44-3a38-41e4-87f2-d79492f0c910 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:38:56.117748 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-cd46ef44-3a38-41e4-87f2-d79492f0c910 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 3cc1496a-defc-48eb-8e12-4b328dd6fa31] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:38:56.124809 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-cd46ef44-3a38-41e4-87f2-d79492f0c910 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:38:56.125262 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-cd46ef44-3a38-41e4-87f2-d79492f0c910 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:38:56.126057 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-cd46ef44-3a38-41e4-87f2-d79492f0c910 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:38:56.126606 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-cd46ef44-3a38-41e4-87f2-d79492f0c910 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:38:56.259777 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-cd46ef44-3a38-41e4-87f2-d79492f0c910 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:38:56.267561 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-cd46ef44-3a38-41e4-87f2-d79492f0c910 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:38:56.269121 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-cd46ef44-3a38-41e4-87f2-d79492f0c910 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:38:56.270249 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-cd46ef44-3a38-41e4-87f2-d79492f0c910 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31" status: 200 len: 1722 microversion: 2.20 time: 0.157808 Jun 07 09:38:56.270801 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 522/1043] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:38:56 2022] GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:38:57.288989 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-eb202867-852d-424c-8cf6-b2a48d87bff2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:38:57.289696 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-eb202867-852d-424c-8cf6-b2a48d87bff2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 3cc1496a-defc-48eb-8e12-4b328dd6fa31] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:38:57.296208 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-eb202867-852d-424c-8cf6-b2a48d87bff2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:38:57.296704 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-eb202867-852d-424c-8cf6-b2a48d87bff2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:38:57.297537 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-eb202867-852d-424c-8cf6-b2a48d87bff2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:38:57.298072 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-eb202867-852d-424c-8cf6-b2a48d87bff2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:38:57.433910 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-eb202867-852d-424c-8cf6-b2a48d87bff2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:38:57.444196 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-eb202867-852d-424c-8cf6-b2a48d87bff2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:38:57.444196 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-eb202867-852d-424c-8cf6-b2a48d87bff2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:38:57.445012 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-eb202867-852d-424c-8cf6-b2a48d87bff2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31" status: 200 len: 1722 microversion: 2.20 time: 0.160486 Jun 07 09:38:57.445564 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 522/1044] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:38:57 2022] GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:38:58.463944 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-0edaf5b8-f8bd-47e4-9447-8302587f4ae4 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:38:58.464656 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-0edaf5b8-f8bd-47e4-9447-8302587f4ae4 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 3cc1496a-defc-48eb-8e12-4b328dd6fa31] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:38:58.472447 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-0edaf5b8-f8bd-47e4-9447-8302587f4ae4 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:38:58.472965 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-0edaf5b8-f8bd-47e4-9447-8302587f4ae4 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:38:58.473860 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-0edaf5b8-f8bd-47e4-9447-8302587f4ae4 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:38:58.474298 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-0edaf5b8-f8bd-47e4-9447-8302587f4ae4 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:38:58.612343 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-0edaf5b8-f8bd-47e4-9447-8302587f4ae4 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:38:58.621080 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-0edaf5b8-f8bd-47e4-9447-8302587f4ae4 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:38:58.622858 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-0edaf5b8-f8bd-47e4-9447-8302587f4ae4 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:38:58.624235 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-0edaf5b8-f8bd-47e4-9447-8302587f4ae4 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31" status: 200 len: 1722 microversion: 2.20 time: 0.164727 Jun 07 09:38:58.635411 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 523/1045] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:38:58 2022] GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:38:59.131871 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [req-375d6cb9-91dc-48d5-b6db-b7256e02cb65 req-8d721fc0-8243-4b1f-85cd-9143b3042fed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cc1496a-defc-48eb-8e12-4b328dd6fa31", "name": "network-vif-deleted", "tag": "f987791d-1369-4164-867a-29c6d0558f0c"}]} {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:38:59.141609 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [req-375d6cb9-91dc-48d5-b6db-b7256e02cb65 req-8d721fc0-8243-4b1f-85cd-9143b3042fed service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:38:59.141962 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [req-375d6cb9-91dc-48d5-b6db-b7256e02cb65 req-8d721fc0-8243-4b1f-85cd-9143b3042fed service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:38:59.154440 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.compute.server_external_events [req-375d6cb9-91dc-48d5-b6db-b7256e02cb65 req-8d721fc0-8243-4b1f-85cd-9143b3042fed service nova] Creating event network-vif-deleted:f987791d-1369-4164-867a-29c6d0558f0c for instance 3cc1496a-defc-48eb-8e12-4b328dd6fa31 on hv-cinder-83699 Jun 07 09:38:59.159942 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [req-375d6cb9-91dc-48d5-b6db-b7256e02cb65 req-8d721fc0-8243-4b1f-85cd-9143b3042fed service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031599 Jun 07 09:38:59.164929 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 523/1046] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Jun 7 09:38:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:38:59.642877 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-8c4a8117-1318-4888-9d58-799dc2889638 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:38:59.643676 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-8c4a8117-1318-4888-9d58-799dc2889638 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 3cc1496a-defc-48eb-8e12-4b328dd6fa31] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:38:59.651855 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-8c4a8117-1318-4888-9d58-799dc2889638 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:38:59.652539 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-8c4a8117-1318-4888-9d58-799dc2889638 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:38:59.653530 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-8c4a8117-1318-4888-9d58-799dc2889638 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:38:59.654114 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-8c4a8117-1318-4888-9d58-799dc2889638 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:38:59.693231 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-8c4a8117-1318-4888-9d58-799dc2889638 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:38:59.696894 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-8c4a8117-1318-4888-9d58-799dc2889638 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:38:59.696894 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.objects.instance [None req-8c4a8117-1318-4888-9d58-799dc2889638 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lazy-loading 'fault' on Instance uuid 3cc1496a-defc-48eb-8e12-4b328dd6fa31 {{(pid=118740) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 09:38:59.740045 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-8c4a8117-1318-4888-9d58-799dc2889638 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:38:59.748617 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-8c4a8117-1318-4888-9d58-799dc2889638 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:38:59.754121 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-8c4a8117-1318-4888-9d58-799dc2889638 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06e30bbe21af428faa5ec0eab414abf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e2a8b0891548428759a52462a2feaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:38:59.754121 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-8c4a8117-1318-4888-9d58-799dc2889638 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31" status: 200 len: 1372 microversion: 2.20 time: 0.112533 Jun 07 09:38:59.754121 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 524/1047] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:38:59 2022] GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31 => generated 1372 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 09:39:00.771371 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-b5f0c50b-6dd6-47f2-8e6e-10a7c354aaf2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:39:00.772022 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-b5f0c50b-6dd6-47f2-8e6e-10a7c354aaf2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 3cc1496a-defc-48eb-8e12-4b328dd6fa31] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:39:00.778167 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b5f0c50b-6dd6-47f2-8e6e-10a7c354aaf2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:39:00.778610 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b5f0c50b-6dd6-47f2-8e6e-10a7c354aaf2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:39:00.779358 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b5f0c50b-6dd6-47f2-8e6e-10a7c354aaf2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:39:00.779787 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b5f0c50b-6dd6-47f2-8e6e-10a7c354aaf2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:39:00.792709 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.wsgi [None req-b5f0c50b-6dd6-47f2-8e6e-10a7c354aaf2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] HTTP exception thrown: Instance 3cc1496a-defc-48eb-8e12-4b328dd6fa31 could not be found. Jun 07 09:39:00.794353 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-b5f0c50b-6dd6-47f2-8e6e-10a7c354aaf2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Request method failure captured: Jun 07 09:39:00.794353 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: request: GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31 HTTP/1.1 Jun 07 09:39:00.794353 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Accept: application/json Jun 07 09:39:00.794353 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Accept-Encoding: identity Jun 07 09:39:00.794353 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Connection: close Jun 07 09:39:00.794353 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Content-Length: 0 Jun 07 09:39:00.794353 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Content-Type: application/json Jun 07 09:39:00.794353 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Host: 10.222.0.57 Jun 07 09:39:00.794353 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Openstack-System-Scope: None Jun 07 09:39:00.794353 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: User-Agent: python-urllib3/1.26.9 Jun 07 09:39:00.794353 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Auth-Token: gAAAAABinxpG9kQvlOuhvKJ2Vqjyrto1ecBjlF2KyUbgRpshzQ_km2MYNcINagmhfoIU6jkOA0ye_TCrmtu5hyCMaDalA9LLQJ2a4ubAMReTHN66VUyeKRdM4jrOOVTdC3MOlDWtgkiVz2vLBdfCOSyYw9WOl0DXA3JGjzoqxlpjH7qXqpqmKwk Jun 07 09:39:00.794353 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Domain-Id: None Jun 07 09:39:00.794353 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Domain-Name: None Jun 07 09:39:00.794353 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Identity-Status: Confirmed Jun 07 09:39:00.794353 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Is-Admin-Project: True Jun 07 09:39:00.794353 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Openstack-Nova-Api-Version: 2.20 Jun 07 09:39:00.794353 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Project-Domain-Id: default Jun 07 09:39:00.794353 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Project-Domain-Name: Default Jun 07 09:39:00.794353 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Project-Id: 61e2a8b0891548428759a52462a2feaa Jun 07 09:39:00.794353 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1858285605 Jun 07 09:39:00.794353 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Role: reader,member Jun 07 09:39:00.794353 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Roles: reader,member Jun 07 09:39:00.795903 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/61e2a8b0891548428759a52462a2feaa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/61e2a8b0891548428759a52462a2feaa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_61e2a8b0891548428759a52462a2feaa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/61e2a8b0891548428759a52462a2feaa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 07 09:39:00.795903 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1858285605 Jun 07 09:39:00.795903 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Tenant-Id: 61e2a8b0891548428759a52462a2feaa Jun 07 09:39:00.795903 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1858285605 Jun 07 09:39:00.795903 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User: tempest-AttachVolumeShelveTestJSON-1858285605-project Jun 07 09:39:00.795903 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User-Domain-Id: default Jun 07 09:39:00.795903 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User-Domain-Name: Default Jun 07 09:39:00.795903 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User-Id: 06e30bbe21af428faa5ec0eab414abf5 Jun 07 09:39:00.795903 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1858285605-project Jun 07 09:39:00.795903 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: method: > Jun 07 09:39:00.795903 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: exception: Instance 3cc1496a-defc-48eb-8e12-4b328dd6fa31 could not be found. Jun 07 09:39:00.795903 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: action_args: {'id': '3cc1496a-defc-48eb-8e12-4b328dd6fa31'} Jun 07 09:39:00.796829 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 09:39:00.796829 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:39:00.796829 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 09:39:00.796829 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 09:39:00.796829 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 09:39:00.796829 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 09:39:00.796829 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 09:39:00.796829 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 09:39:00.796829 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 09:39:00.796829 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 09:39:00.796829 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3cc1496a-defc-48eb-8e12-4b328dd6fa31 could not be found. Jun 07 09:39:00.796829 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:39:00.796829 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:39:00.796829 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:39:00.796829 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:39:00.796829 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:39:00.796829 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:39:00.796829 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 09:39:00.796829 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 09:39:00.796829 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 09:39:00.798445 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 09:39:00.798445 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 09:39:00.798445 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 09:39:00.798445 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 09:39:00.798445 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 09:39:00.798445 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 09:39:00.798445 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 09:39:00.798445 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cc1496a-defc-48eb-8e12-4b328dd6fa31 could not be found. Jun 07 09:39:00.798445 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:39:00.798445 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:39:00.798445 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:39:00.798445 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:39:00.798445 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:39:00.798445 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:39:00.798445 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 09:39:00.798445 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 09:39:00.798445 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cc1496a-defc-48eb-8e12-4b328dd6fa31 could not be found. Jun 07 09:39:00.798445 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:39:00.799969 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-b5f0c50b-6dd6-47f2-8e6e-10a7c354aaf2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Returning 404 to user: Instance 3cc1496a-defc-48eb-8e12-4b328dd6fa31 could not be found. {{(pid=118741) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 09:39:00.799969 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-b5f0c50b-6dd6-47f2-8e6e-10a7c354aaf2 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31" status: 404 len: 111 microversion: 2.20 time: 0.029685 Jun 07 09:39:00.799969 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 524/1048] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:39:00 2022] GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 07 09:39:00.804798 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-eb495db3-a022-41d5-b32b-96c5a2ad9770 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '.version_select at 0x7f5c93a4d040>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:39:00.889924 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-eb495db3-a022-41d5-b32b-96c5a2ad9770 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1861561043" status: 204 len: 0 microversion: 2.20 time: 0.080201 Jun 07 09:39:00.889924 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 525/1049] 10.222.0.57 () {60 vars in 1261 bytes} [Tue Jun 7 09:39:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1861561043 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 07 09:39:03.095182 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-0100664d-d936-46ab-81c7-fd2ac1fac718 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:39:03.097929 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-0100664d-d936-46ab-81c7-fd2ac1fac718 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 3cc1496a-defc-48eb-8e12-4b328dd6fa31] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:39:03.102556 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-0100664d-d936-46ab-81c7-fd2ac1fac718 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:39:03.103108 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-0100664d-d936-46ab-81c7-fd2ac1fac718 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:39:03.103951 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-0100664d-d936-46ab-81c7-fd2ac1fac718 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:39:03.104393 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-0100664d-d936-46ab-81c7-fd2ac1fac718 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:39:03.117609 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.wsgi [None req-0100664d-d936-46ab-81c7-fd2ac1fac718 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] HTTP exception thrown: Instance 3cc1496a-defc-48eb-8e12-4b328dd6fa31 could not be found. Jun 07 09:39:03.120815 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-0100664d-d936-46ab-81c7-fd2ac1fac718 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Request method failure captured: Jun 07 09:39:03.120815 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: request: DELETE /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31 HTTP/1.1 Jun 07 09:39:03.120815 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Accept: application/json Jun 07 09:39:03.120815 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Accept-Encoding: identity Jun 07 09:39:03.120815 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Connection: close Jun 07 09:39:03.120815 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Content-Length: 0 Jun 07 09:39:03.120815 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Content-Type: application/json Jun 07 09:39:03.120815 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Host: 10.222.0.57 Jun 07 09:39:03.120815 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Openstack-System-Scope: None Jun 07 09:39:03.120815 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: User-Agent: python-urllib3/1.26.9 Jun 07 09:39:03.120815 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Auth-Token: gAAAAABinxpG9kQvlOuhvKJ2Vqjyrto1ecBjlF2KyUbgRpshzQ_km2MYNcINagmhfoIU6jkOA0ye_TCrmtu5hyCMaDalA9LLQJ2a4ubAMReTHN66VUyeKRdM4jrOOVTdC3MOlDWtgkiVz2vLBdfCOSyYw9WOl0DXA3JGjzoqxlpjH7qXqpqmKwk Jun 07 09:39:03.120815 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Domain-Id: None Jun 07 09:39:03.120815 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Domain-Name: None Jun 07 09:39:03.120815 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Identity-Status: Confirmed Jun 07 09:39:03.120815 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Is-Admin-Project: True Jun 07 09:39:03.120815 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Openstack-Nova-Api-Version: 2.20 Jun 07 09:39:03.120815 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Project-Domain-Id: default Jun 07 09:39:03.120815 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Project-Domain-Name: Default Jun 07 09:39:03.120815 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Project-Id: 61e2a8b0891548428759a52462a2feaa Jun 07 09:39:03.120815 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1858285605 Jun 07 09:39:03.120815 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Role: reader,member Jun 07 09:39:03.120815 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Roles: reader,member Jun 07 09:39:03.122658 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/61e2a8b0891548428759a52462a2feaa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/61e2a8b0891548428759a52462a2feaa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_61e2a8b0891548428759a52462a2feaa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/61e2a8b0891548428759a52462a2feaa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 07 09:39:03.122658 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1858285605 Jun 07 09:39:03.122658 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Tenant-Id: 61e2a8b0891548428759a52462a2feaa Jun 07 09:39:03.122658 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1858285605 Jun 07 09:39:03.122658 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User: tempest-AttachVolumeShelveTestJSON-1858285605-project Jun 07 09:39:03.122658 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User-Domain-Id: default Jun 07 09:39:03.122658 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User-Domain-Name: Default Jun 07 09:39:03.122658 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User-Id: 06e30bbe21af428faa5ec0eab414abf5 Jun 07 09:39:03.122658 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1858285605-project Jun 07 09:39:03.122658 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: method: > Jun 07 09:39:03.122658 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: exception: Instance 3cc1496a-defc-48eb-8e12-4b328dd6fa31 could not be found. Jun 07 09:39:03.122658 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: action_args: {'id': '3cc1496a-defc-48eb-8e12-4b328dd6fa31'} Jun 07 09:39:03.123581 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 09:39:03.123581 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:39:03.123581 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 09:39:03.123581 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 09:39:03.123581 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 09:39:03.123581 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 09:39:03.123581 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 09:39:03.123581 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 09:39:03.123581 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 09:39:03.123581 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 09:39:03.123581 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3cc1496a-defc-48eb-8e12-4b328dd6fa31 could not be found. Jun 07 09:39:03.123581 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:39:03.123581 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:39:03.123581 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:39:03.123581 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:39:03.123581 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:39:03.123581 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:39:03.123581 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 09:39:03.123581 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 09:39:03.123581 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 09:39:03.125315 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 09:39:03.125315 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 07 09:39:03.125315 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 07 09:39:03.125315 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 07 09:39:03.125315 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 07 09:39:03.125315 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 09:39:03.125315 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 09:39:03.125315 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 09:39:03.125315 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 09:39:03.125315 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cc1496a-defc-48eb-8e12-4b328dd6fa31 could not be found. Jun 07 09:39:03.125315 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:39:03.125315 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:39:03.125315 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:39:03.125315 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:39:03.125315 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:39:03.125315 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:39:03.125315 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 09:39:03.125315 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 09:39:03.125315 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cc1496a-defc-48eb-8e12-4b328dd6fa31 could not be found. Jun 07 09:39:03.125315 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:39:03.126916 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-0100664d-d936-46ab-81c7-fd2ac1fac718 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Returning 404 to user: Instance 3cc1496a-defc-48eb-8e12-4b328dd6fa31 could not be found. {{(pid=118741) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 09:39:03.126916 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-0100664d-d936-46ab-81c7-fd2ac1fac718 tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "DELETE /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31" status: 404 len: 111 microversion: 2.20 time: 0.029463 Jun 07 09:39:03.126916 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 525/1050] 10.222.0.57 () {60 vars in 1279 bytes} [Tue Jun 7 09:39:03 2022] DELETE /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 07 09:39:03.129412 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-33362ce5-394f-426e-8f32-95a7c034a2dd tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:39:03.130517 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-33362ce5-394f-426e-8f32-95a7c034a2dd tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 3cc1496a-defc-48eb-8e12-4b328dd6fa31] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:39:03.137651 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-33362ce5-394f-426e-8f32-95a7c034a2dd tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:39:03.138088 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-33362ce5-394f-426e-8f32-95a7c034a2dd tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:39:03.142823 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-33362ce5-394f-426e-8f32-95a7c034a2dd tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:39:03.142823 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-33362ce5-394f-426e-8f32-95a7c034a2dd tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:39:03.152546 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.wsgi [None req-33362ce5-394f-426e-8f32-95a7c034a2dd tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] HTTP exception thrown: Instance 3cc1496a-defc-48eb-8e12-4b328dd6fa31 could not be found. Jun 07 09:39:03.154129 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-33362ce5-394f-426e-8f32-95a7c034a2dd tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Request method failure captured: Jun 07 09:39:03.154129 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: request: GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31 HTTP/1.1 Jun 07 09:39:03.154129 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Accept: application/json Jun 07 09:39:03.154129 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Accept-Encoding: identity Jun 07 09:39:03.154129 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Connection: close Jun 07 09:39:03.154129 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Content-Length: 0 Jun 07 09:39:03.154129 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Content-Type: application/json Jun 07 09:39:03.154129 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Host: 10.222.0.57 Jun 07 09:39:03.154129 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Openstack-System-Scope: None Jun 07 09:39:03.154129 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: User-Agent: python-urllib3/1.26.9 Jun 07 09:39:03.154129 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Auth-Token: gAAAAABinxpG9kQvlOuhvKJ2Vqjyrto1ecBjlF2KyUbgRpshzQ_km2MYNcINagmhfoIU6jkOA0ye_TCrmtu5hyCMaDalA9LLQJ2a4ubAMReTHN66VUyeKRdM4jrOOVTdC3MOlDWtgkiVz2vLBdfCOSyYw9WOl0DXA3JGjzoqxlpjH7qXqpqmKwk Jun 07 09:39:03.154129 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Domain-Id: None Jun 07 09:39:03.154129 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Domain-Name: None Jun 07 09:39:03.154129 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Identity-Status: Confirmed Jun 07 09:39:03.154129 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Is-Admin-Project: True Jun 07 09:39:03.154129 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Openstack-Nova-Api-Version: 2.20 Jun 07 09:39:03.154129 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Domain-Id: default Jun 07 09:39:03.154129 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Domain-Name: Default Jun 07 09:39:03.154129 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Id: 61e2a8b0891548428759a52462a2feaa Jun 07 09:39:03.154129 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1858285605 Jun 07 09:39:03.154129 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Role: reader,member Jun 07 09:39:03.154129 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Roles: reader,member Jun 07 09:39:03.156050 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/61e2a8b0891548428759a52462a2feaa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/61e2a8b0891548428759a52462a2feaa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_61e2a8b0891548428759a52462a2feaa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/61e2a8b0891548428759a52462a2feaa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 07 09:39:03.156050 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1858285605 Jun 07 09:39:03.156050 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Tenant-Id: 61e2a8b0891548428759a52462a2feaa Jun 07 09:39:03.156050 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1858285605 Jun 07 09:39:03.156050 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User: tempest-AttachVolumeShelveTestJSON-1858285605-project Jun 07 09:39:03.156050 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Domain-Id: default Jun 07 09:39:03.156050 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Domain-Name: Default Jun 07 09:39:03.156050 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Id: 06e30bbe21af428faa5ec0eab414abf5 Jun 07 09:39:03.156050 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1858285605-project Jun 07 09:39:03.156050 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: method: > Jun 07 09:39:03.156050 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: exception: Instance 3cc1496a-defc-48eb-8e12-4b328dd6fa31 could not be found. Jun 07 09:39:03.156050 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: action_args: {'id': '3cc1496a-defc-48eb-8e12-4b328dd6fa31'} Jun 07 09:39:03.157175 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 09:39:03.157175 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:39:03.157175 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 09:39:03.157175 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 09:39:03.157175 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 09:39:03.157175 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 09:39:03.157175 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 09:39:03.157175 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 09:39:03.157175 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 09:39:03.157175 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 09:39:03.157175 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3cc1496a-defc-48eb-8e12-4b328dd6fa31 could not be found. Jun 07 09:39:03.157175 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:39:03.157175 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:39:03.157175 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:39:03.157175 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:39:03.157175 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:39:03.157175 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:39:03.157175 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 09:39:03.157175 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 09:39:03.157175 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 09:39:03.158423 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 09:39:03.158423 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 09:39:03.158423 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 09:39:03.158423 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 09:39:03.158423 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 09:39:03.158423 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 09:39:03.158423 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 09:39:03.158423 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cc1496a-defc-48eb-8e12-4b328dd6fa31 could not be found. Jun 07 09:39:03.158423 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:39:03.158423 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:39:03.158423 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:39:03.158423 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:39:03.158423 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:39:03.158423 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:39:03.158423 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 09:39:03.158423 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 09:39:03.158423 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cc1496a-defc-48eb-8e12-4b328dd6fa31 could not be found. Jun 07 09:39:03.158423 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:39:03.159819 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-33362ce5-394f-426e-8f32-95a7c034a2dd tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Returning 404 to user: Instance 3cc1496a-defc-48eb-8e12-4b328dd6fa31 could not be found. {{(pid=118740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 09:39:03.159819 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-33362ce5-394f-426e-8f32-95a7c034a2dd tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31" status: 404 len: 111 microversion: 2.20 time: 0.030280 Jun 07 09:39:03.159819 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 526/1051] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:39:03 2022] GET /compute/v2.1/servers/3cc1496a-defc-48eb-8e12-4b328dd6fa31 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 07 09:39:04.443842 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-9ebd468c-4153-40a9-af23-35ccf61400fc tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:39:04.444361 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-9ebd468c-4153-40a9-af23-35ccf61400fc tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:39:04.450818 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-9ebd468c-4153-40a9-af23-35ccf61400fc tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:39:04.451271 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-9ebd468c-4153-40a9-af23-35ccf61400fc tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:39:04.452104 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-9ebd468c-4153-40a9-af23-35ccf61400fc tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:39:04.452537 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-9ebd468c-4153-40a9-af23-35ccf61400fc tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:39:04.466269 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.wsgi [None req-9ebd468c-4153-40a9-af23-35ccf61400fc tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] HTTP exception thrown: Instance 102039c7-8224-43f7-9fb8-90b82968cfa2 could not be found. Jun 07 09:39:04.467820 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-9ebd468c-4153-40a9-af23-35ccf61400fc tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Request method failure captured: Jun 07 09:39:04.467820 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: request: DELETE /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 HTTP/1.1 Jun 07 09:39:04.467820 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Accept: application/json Jun 07 09:39:04.467820 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Accept-Encoding: identity Jun 07 09:39:04.467820 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Connection: close Jun 07 09:39:04.467820 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Content-Length: 0 Jun 07 09:39:04.467820 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Content-Type: application/json Jun 07 09:39:04.467820 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Host: 10.222.0.57 Jun 07 09:39:04.467820 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Openstack-System-Scope: None Jun 07 09:39:04.467820 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: User-Agent: python-urllib3/1.26.9 Jun 07 09:39:04.467820 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Auth-Token: gAAAAABinxpG9kQvlOuhvKJ2Vqjyrto1ecBjlF2KyUbgRpshzQ_km2MYNcINagmhfoIU6jkOA0ye_TCrmtu5hyCMaDalA9LLQJ2a4ubAMReTHN66VUyeKRdM4jrOOVTdC3MOlDWtgkiVz2vLBdfCOSyYw9WOl0DXA3JGjzoqxlpjH7qXqpqmKwk Jun 07 09:39:04.467820 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Domain-Id: None Jun 07 09:39:04.467820 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Domain-Name: None Jun 07 09:39:04.467820 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Identity-Status: Confirmed Jun 07 09:39:04.467820 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Is-Admin-Project: True Jun 07 09:39:04.467820 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Openstack-Nova-Api-Version: 2.20 Jun 07 09:39:04.467820 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Project-Domain-Id: default Jun 07 09:39:04.467820 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Project-Domain-Name: Default Jun 07 09:39:04.467820 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Project-Id: 61e2a8b0891548428759a52462a2feaa Jun 07 09:39:04.467820 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1858285605 Jun 07 09:39:04.467820 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Role: reader,member Jun 07 09:39:04.467820 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Roles: reader,member Jun 07 09:39:04.469576 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/61e2a8b0891548428759a52462a2feaa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/61e2a8b0891548428759a52462a2feaa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_61e2a8b0891548428759a52462a2feaa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/61e2a8b0891548428759a52462a2feaa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 07 09:39:04.469576 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1858285605 Jun 07 09:39:04.469576 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Tenant-Id: 61e2a8b0891548428759a52462a2feaa Jun 07 09:39:04.469576 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1858285605 Jun 07 09:39:04.469576 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User: tempest-AttachVolumeShelveTestJSON-1858285605-project Jun 07 09:39:04.469576 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User-Domain-Id: default Jun 07 09:39:04.469576 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User-Domain-Name: Default Jun 07 09:39:04.469576 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User-Id: 06e30bbe21af428faa5ec0eab414abf5 Jun 07 09:39:04.469576 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1858285605-project Jun 07 09:39:04.469576 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: method: > Jun 07 09:39:04.469576 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: exception: Instance 102039c7-8224-43f7-9fb8-90b82968cfa2 could not be found. Jun 07 09:39:04.469576 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: action_args: {'id': '102039c7-8224-43f7-9fb8-90b82968cfa2'} Jun 07 09:39:04.470370 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 09:39:04.470370 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:39:04.470370 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 09:39:04.470370 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 09:39:04.470370 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 09:39:04.470370 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 09:39:04.470370 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 09:39:04.470370 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 09:39:04.470370 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 09:39:04.470370 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 09:39:04.470370 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 102039c7-8224-43f7-9fb8-90b82968cfa2 could not be found. Jun 07 09:39:04.470370 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:39:04.470370 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:39:04.470370 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:39:04.470370 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:39:04.470370 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:39:04.470370 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:39:04.470370 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 09:39:04.470370 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 09:39:04.470370 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 09:39:04.471676 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 09:39:04.471676 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 07 09:39:04.471676 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 07 09:39:04.471676 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 07 09:39:04.471676 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 07 09:39:04.471676 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 09:39:04.471676 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 09:39:04.471676 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 09:39:04.471676 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 09:39:04.471676 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 102039c7-8224-43f7-9fb8-90b82968cfa2 could not be found. Jun 07 09:39:04.471676 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:39:04.471676 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:39:04.471676 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:39:04.471676 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:39:04.471676 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:39:04.471676 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:39:04.471676 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 09:39:04.471676 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 09:39:04.471676 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 102039c7-8224-43f7-9fb8-90b82968cfa2 could not be found. Jun 07 09:39:04.471676 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:39:04.473238 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-9ebd468c-4153-40a9-af23-35ccf61400fc tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Returning 404 to user: Instance 102039c7-8224-43f7-9fb8-90b82968cfa2 could not be found. {{(pid=118741) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 09:39:04.473238 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-9ebd468c-4153-40a9-af23-35ccf61400fc tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "DELETE /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 404 len: 111 microversion: 2.20 time: 0.029283 Jun 07 09:39:04.473238 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 526/1052] 10.222.0.57 () {60 vars in 1279 bytes} [Tue Jun 7 09:39:04 2022] DELETE /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 07 09:39:04.478440 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-1cc4254c-b022-4cac-b3b3-7736a2059a1e tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:39:04.484402 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-1cc4254c-b022-4cac-b3b3-7736a2059a1e tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] [instance: 102039c7-8224-43f7-9fb8-90b82968cfa2] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:39:04.485582 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-1cc4254c-b022-4cac-b3b3-7736a2059a1e tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:39:04.486033 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-1cc4254c-b022-4cac-b3b3-7736a2059a1e tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:39:04.486827 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-1cc4254c-b022-4cac-b3b3-7736a2059a1e tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:39:04.487269 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-1cc4254c-b022-4cac-b3b3-7736a2059a1e tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:39:04.500563 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.wsgi [None req-1cc4254c-b022-4cac-b3b3-7736a2059a1e tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] HTTP exception thrown: Instance 102039c7-8224-43f7-9fb8-90b82968cfa2 could not be found. Jun 07 09:39:04.502122 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-1cc4254c-b022-4cac-b3b3-7736a2059a1e tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Request method failure captured: Jun 07 09:39:04.502122 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: request: GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 HTTP/1.1 Jun 07 09:39:04.502122 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Accept: application/json Jun 07 09:39:04.502122 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Accept-Encoding: identity Jun 07 09:39:04.502122 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Connection: close Jun 07 09:39:04.502122 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Content-Length: 0 Jun 07 09:39:04.502122 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Content-Type: application/json Jun 07 09:39:04.502122 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Host: 10.222.0.57 Jun 07 09:39:04.502122 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Openstack-System-Scope: None Jun 07 09:39:04.502122 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: User-Agent: python-urllib3/1.26.9 Jun 07 09:39:04.502122 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Auth-Token: gAAAAABinxpG9kQvlOuhvKJ2Vqjyrto1ecBjlF2KyUbgRpshzQ_km2MYNcINagmhfoIU6jkOA0ye_TCrmtu5hyCMaDalA9LLQJ2a4ubAMReTHN66VUyeKRdM4jrOOVTdC3MOlDWtgkiVz2vLBdfCOSyYw9WOl0DXA3JGjzoqxlpjH7qXqpqmKwk Jun 07 09:39:04.502122 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Domain-Id: None Jun 07 09:39:04.502122 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Domain-Name: None Jun 07 09:39:04.502122 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Identity-Status: Confirmed Jun 07 09:39:04.502122 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Is-Admin-Project: True Jun 07 09:39:04.502122 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Openstack-Nova-Api-Version: 2.20 Jun 07 09:39:04.502122 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Domain-Id: default Jun 07 09:39:04.502122 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Domain-Name: Default Jun 07 09:39:04.502122 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Id: 61e2a8b0891548428759a52462a2feaa Jun 07 09:39:04.502122 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1858285605 Jun 07 09:39:04.502122 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Role: reader,member Jun 07 09:39:04.502122 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Roles: reader,member Jun 07 09:39:04.503952 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/61e2a8b0891548428759a52462a2feaa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/61e2a8b0891548428759a52462a2feaa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_61e2a8b0891548428759a52462a2feaa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/61e2a8b0891548428759a52462a2feaa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 07 09:39:04.503952 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1858285605 Jun 07 09:39:04.503952 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Tenant-Id: 61e2a8b0891548428759a52462a2feaa Jun 07 09:39:04.503952 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1858285605 Jun 07 09:39:04.503952 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User: tempest-AttachVolumeShelveTestJSON-1858285605-project Jun 07 09:39:04.503952 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Domain-Id: default Jun 07 09:39:04.503952 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Domain-Name: Default Jun 07 09:39:04.503952 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Id: 06e30bbe21af428faa5ec0eab414abf5 Jun 07 09:39:04.503952 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1858285605-project Jun 07 09:39:04.503952 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: method: > Jun 07 09:39:04.503952 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: exception: Instance 102039c7-8224-43f7-9fb8-90b82968cfa2 could not be found. Jun 07 09:39:04.503952 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: action_args: {'id': '102039c7-8224-43f7-9fb8-90b82968cfa2'} Jun 07 09:39:04.507473 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 09:39:04.507473 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:39:04.507473 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 09:39:04.507473 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 09:39:04.507473 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 09:39:04.507473 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 09:39:04.507473 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 09:39:04.507473 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 09:39:04.507473 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 09:39:04.507473 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 09:39:04.507473 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 102039c7-8224-43f7-9fb8-90b82968cfa2 could not be found. Jun 07 09:39:04.507473 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:39:04.507473 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:39:04.507473 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:39:04.507473 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:39:04.507473 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:39:04.507473 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:39:04.507473 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 09:39:04.507473 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 09:39:04.507473 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 09:39:04.508953 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 09:39:04.508953 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 09:39:04.508953 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 09:39:04.508953 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 09:39:04.508953 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 09:39:04.508953 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 09:39:04.508953 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 09:39:04.508953 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 102039c7-8224-43f7-9fb8-90b82968cfa2 could not be found. Jun 07 09:39:04.508953 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:39:04.508953 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:39:04.508953 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:39:04.508953 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:39:04.508953 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:39:04.508953 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:39:04.508953 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 09:39:04.508953 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 09:39:04.508953 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 102039c7-8224-43f7-9fb8-90b82968cfa2 could not be found. Jun 07 09:39:04.508953 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:39:04.510296 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-1cc4254c-b022-4cac-b3b3-7736a2059a1e tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] Returning 404 to user: Instance 102039c7-8224-43f7-9fb8-90b82968cfa2 could not be found. {{(pid=118740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 09:39:04.510296 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-1cc4254c-b022-4cac-b3b3-7736a2059a1e tempest-AttachVolumeShelveTestJSON-1858285605 tempest-AttachVolumeShelveTestJSON-1858285605-project] 10.222.0.57 "GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2" status: 404 len: 111 microversion: 2.20 time: 0.029751 Jun 07 09:39:04.510296 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 527/1053] 10.222.0.57 () {60 vars in 1276 bytes} [Tue Jun 7 09:39:04 2022] GET /compute/v2.1/servers/102039c7-8224-43f7-9fb8-90b82968cfa2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 07 09:39:10.468800 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-ead0006e-ba17-4491-86d6-c5d17d9ae450 tempest-VolumesNegativeTest-625773642 tempest-VolumesNegativeTest-625773642-project] Action: 'create', calling method: .version_select at 0x7f5c929163a0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1903732514", "metadata": {"Type": "work"}}} {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:39:10.474746 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-ead0006e-ba17-4491-86d6-c5d17d9ae450 tempest-VolumesNegativeTest-625773642 tempest-VolumesNegativeTest-625773642-project] Request method failure captured: Jun 07 09:39:10.474746 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 07 09:39:10.474746 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Accept: application/json Jun 07 09:39:10.474746 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Accept-Encoding: identity Jun 07 09:39:10.474746 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Connection: close Jun 07 09:39:10.474746 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Content-Length: 122 Jun 07 09:39:10.474746 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Content-Type: application/json Jun 07 09:39:10.474746 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Host: 10.222.0.57 Jun 07 09:39:10.474746 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Openstack-System-Scope: None Jun 07 09:39:10.474746 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: User-Agent: python-urllib3/1.26.9 Jun 07 09:39:10.474746 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Auth-Token: gAAAAABinxy-fBtsvlDABvxInK_sbLWtcLaIPlf7tJInA8wO6wacp7yvUlGQEiavtswPteZPGBdysDwiQaK8glPeuxlY9Q-1fNbiu20mn13QK8j0z6UisfNHjiWtCJtPTHmsekT-xCr_kxxRU0mns7pfMQG86Aznpjtdd1XBmsxTLX5dwWjw__8 Jun 07 09:39:10.474746 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Domain-Id: None Jun 07 09:39:10.474746 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Domain-Name: None Jun 07 09:39:10.474746 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Identity-Status: Confirmed Jun 07 09:39:10.474746 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Is-Admin-Project: True Jun 07 09:39:10.474746 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Project-Domain-Id: default Jun 07 09:39:10.474746 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Project-Domain-Name: Default Jun 07 09:39:10.474746 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Project-Id: c72d6318734e45e8890bed7246ac8e92 Jun 07 09:39:10.474746 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Project-Name: tempest-VolumesNegativeTest-625773642 Jun 07 09:39:10.474746 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Role: reader,member Jun 07 09:39:10.474746 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Roles: reader,member Jun 07 09:39:10.476706 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c72d6318734e45e8890bed7246ac8e92"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c72d6318734e45e8890bed7246ac8e92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c72d6318734e45e8890bed7246ac8e92"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c72d6318734e45e8890bed7246ac8e92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 07 09:39:10.476706 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Tenant: tempest-VolumesNegativeTest-625773642 Jun 07 09:39:10.476706 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Tenant-Id: c72d6318734e45e8890bed7246ac8e92 Jun 07 09:39:10.476706 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Tenant-Name: tempest-VolumesNegativeTest-625773642 Jun 07 09:39:10.476706 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User: tempest-VolumesNegativeTest-625773642-project Jun 07 09:39:10.476706 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User-Domain-Id: default Jun 07 09:39:10.476706 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User-Domain-Name: Default Jun 07 09:39:10.476706 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User-Id: a9ec7c5401274c41a1c3a34632f60071 Jun 07 09:39:10.476706 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User-Name: tempest-VolumesNegativeTest-625773642-project Jun 07 09:39:10.476706 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Jun 07 09:39:10.476706 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1903732514", "metadata": {"Type": "work"}}} Jun 07 09:39:10.476706 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: method: Jun 07 09:39:10.476706 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 07 09:39:10.477727 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1903732514', 'metadata': {'Type': 'work'}}}} Jun 07 09:39:10.477727 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 09:39:10.477727 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:39:10.477727 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 07 09:39:10.477727 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 07 09:39:10.477727 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 07 09:39:10.477727 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi raise error Jun 07 09:39:10.477727 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 07 09:39:10.477727 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:39:10.477727 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 07 09:39:10.477727 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 07 09:39:10.477727 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:39:10.477727 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 07 09:39:10.477727 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi '#$%' Jun 07 09:39:10.477727 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:39:10.477727 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:39:10.477727 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:39:10.477727 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:39:10.477727 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:39:10.477727 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:39:10.477727 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 09:39:10.477727 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 09:39:10.479139 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 09:39:10.479139 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 09:39:10.479139 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 09:39:10.479139 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 09:39:10.479139 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 07 09:39:10.479139 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 07 09:39:10.479139 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 07 09:39:10.479139 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 07 09:39:10.479139 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 07 09:39:10.479139 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 07 09:39:10.479139 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 07 09:39:10.479139 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:39:10.479139 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:39:10.479139 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:39:10.479139 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:39:10.479139 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:39:10.479139 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:39:10.479139 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 07 09:39:10.479139 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 07 09:39:10.480318 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 07 09:39:10.480318 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:39:10.480318 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-ead0006e-ba17-4491-86d6-c5d17d9ae450 tempest-VolumesNegativeTest-625773642 tempest-VolumesNegativeTest-625773642-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118741) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 09:39:10.480318 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-ead0006e-ba17-4491-86d6-c5d17d9ae450 tempest-VolumesNegativeTest-625773642 tempest-VolumesNegativeTest-625773642-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.258886 Jun 07 09:39:10.480318 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 527/1054] 10.222.0.57 () {60 vars in 1155 bytes} [Tue Jun 7 09:39:10 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 260 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 07 09:39:10.487077 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-10e1348e-6178-4c35-bd17-b55bc745ddd3 tempest-VolumesNegativeTest-625773642 tempest-VolumesNegativeTest-625773642-project] Action: 'create', calling method: .version_select at 0x7f5c921b5700>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-488527141", "metadata": {"Type": "work"}}} {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:39:10.490899 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-10e1348e-6178-4c35-bd17-b55bc745ddd3 tempest-VolumesNegativeTest-625773642 tempest-VolumesNegativeTest-625773642-project] Request method failure captured: Jun 07 09:39:10.490899 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 07 09:39:10.490899 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Accept: application/json Jun 07 09:39:10.490899 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Accept-Encoding: identity Jun 07 09:39:10.490899 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Connection: close Jun 07 09:39:10.490899 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Content-Length: 119 Jun 07 09:39:10.490899 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Content-Type: application/json Jun 07 09:39:10.490899 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Host: 10.222.0.57 Jun 07 09:39:10.490899 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Openstack-System-Scope: None Jun 07 09:39:10.490899 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: User-Agent: python-urllib3/1.26.9 Jun 07 09:39:10.490899 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Auth-Token: gAAAAABinxy-fBtsvlDABvxInK_sbLWtcLaIPlf7tJInA8wO6wacp7yvUlGQEiavtswPteZPGBdysDwiQaK8glPeuxlY9Q-1fNbiu20mn13QK8j0z6UisfNHjiWtCJtPTHmsekT-xCr_kxxRU0mns7pfMQG86Aznpjtdd1XBmsxTLX5dwWjw__8 Jun 07 09:39:10.490899 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Domain-Id: None Jun 07 09:39:10.490899 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Domain-Name: None Jun 07 09:39:10.490899 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Identity-Status: Confirmed Jun 07 09:39:10.490899 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Is-Admin-Project: True Jun 07 09:39:10.490899 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Domain-Id: default Jun 07 09:39:10.490899 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Domain-Name: Default Jun 07 09:39:10.490899 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Id: c72d6318734e45e8890bed7246ac8e92 Jun 07 09:39:10.490899 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Name: tempest-VolumesNegativeTest-625773642 Jun 07 09:39:10.490899 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Role: reader,member Jun 07 09:39:10.490899 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Roles: reader,member Jun 07 09:39:10.492551 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c72d6318734e45e8890bed7246ac8e92"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c72d6318734e45e8890bed7246ac8e92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c72d6318734e45e8890bed7246ac8e92"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c72d6318734e45e8890bed7246ac8e92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 07 09:39:10.492551 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Tenant: tempest-VolumesNegativeTest-625773642 Jun 07 09:39:10.492551 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Tenant-Id: c72d6318734e45e8890bed7246ac8e92 Jun 07 09:39:10.492551 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Tenant-Name: tempest-VolumesNegativeTest-625773642 Jun 07 09:39:10.492551 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User: tempest-VolumesNegativeTest-625773642-project Jun 07 09:39:10.492551 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Domain-Id: default Jun 07 09:39:10.492551 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Domain-Name: Default Jun 07 09:39:10.492551 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Id: a9ec7c5401274c41a1c3a34632f60071 Jun 07 09:39:10.492551 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Name: tempest-VolumesNegativeTest-625773642-project Jun 07 09:39:10.492551 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Jun 07 09:39:10.492551 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-488527141", "metadata": {"Type": "work"}}} Jun 07 09:39:10.492551 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: method: Jun 07 09:39:10.492551 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 07 09:39:10.493584 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-488527141', 'metadata': {'Type': 'work'}}}} Jun 07 09:39:10.493584 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 09:39:10.493584 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:39:10.493584 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 07 09:39:10.493584 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 07 09:39:10.493584 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 07 09:39:10.493584 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise error Jun 07 09:39:10.493584 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 07 09:39:10.493584 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:39:10.493584 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 07 09:39:10.493584 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 07 09:39:10.493584 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:39:10.493584 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 07 09:39:10.493584 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi '0' Jun 07 09:39:10.493584 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:39:10.493584 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:39:10.493584 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:39:10.493584 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:39:10.493584 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:39:10.493584 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:39:10.493584 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 09:39:10.493584 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 09:39:10.495335 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 09:39:10.495335 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 09:39:10.495335 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 09:39:10.495335 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 09:39:10.495335 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 07 09:39:10.495335 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 07 09:39:10.495335 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 07 09:39:10.495335 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 07 09:39:10.495335 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 07 09:39:10.495335 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 07 09:39:10.495335 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 07 09:39:10.495335 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:39:10.495335 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:39:10.495335 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:39:10.495335 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:39:10.495335 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:39:10.495335 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:39:10.495335 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 07 09:39:10.495335 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 07 09:39:10.496531 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 07 09:39:10.496531 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:39:10.496531 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-10e1348e-6178-4c35-bd17-b55bc745ddd3 tempest-VolumesNegativeTest-625773642 tempest-VolumesNegativeTest-625773642-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 09:39:10.496531 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-10e1348e-6178-4c35-bd17-b55bc745ddd3 tempest-VolumesNegativeTest-625773642 tempest-VolumesNegativeTest-625773642-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010927 Jun 07 09:39:10.496531 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 528/1055] 10.222.0.57 () {60 vars in 1155 bytes} [Tue Jun 7 09:39:10 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 07 09:39:10.508399 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-617e2170-89c5-440c-85d4-d7f16157ffa2 tempest-VolumesNegativeTest-625773642 tempest-VolumesNegativeTest-625773642-project] Action: 'create', calling method: .version_select at 0x7f5c926b1af0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-50708424", "metadata": {"Type": "work"}}} {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:39:10.511782 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-617e2170-89c5-440c-85d4-d7f16157ffa2 tempest-VolumesNegativeTest-625773642 tempest-VolumesNegativeTest-625773642-project] Request method failure captured: Jun 07 09:39:10.511782 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 07 09:39:10.511782 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Accept: application/json Jun 07 09:39:10.511782 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Accept-Encoding: identity Jun 07 09:39:10.511782 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Connection: close Jun 07 09:39:10.511782 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Content-Length: 117 Jun 07 09:39:10.511782 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Content-Type: application/json Jun 07 09:39:10.511782 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Host: 10.222.0.57 Jun 07 09:39:10.511782 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Openstack-System-Scope: None Jun 07 09:39:10.511782 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: User-Agent: python-urllib3/1.26.9 Jun 07 09:39:10.511782 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Auth-Token: gAAAAABinxy-fBtsvlDABvxInK_sbLWtcLaIPlf7tJInA8wO6wacp7yvUlGQEiavtswPteZPGBdysDwiQaK8glPeuxlY9Q-1fNbiu20mn13QK8j0z6UisfNHjiWtCJtPTHmsekT-xCr_kxxRU0mns7pfMQG86Aznpjtdd1XBmsxTLX5dwWjw__8 Jun 07 09:39:10.511782 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Domain-Id: None Jun 07 09:39:10.511782 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Domain-Name: None Jun 07 09:39:10.511782 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Identity-Status: Confirmed Jun 07 09:39:10.511782 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Is-Admin-Project: True Jun 07 09:39:10.511782 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Project-Domain-Id: default Jun 07 09:39:10.511782 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Project-Domain-Name: Default Jun 07 09:39:10.511782 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Project-Id: c72d6318734e45e8890bed7246ac8e92 Jun 07 09:39:10.511782 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Project-Name: tempest-VolumesNegativeTest-625773642 Jun 07 09:39:10.511782 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Role: reader,member Jun 07 09:39:10.511782 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Roles: reader,member Jun 07 09:39:10.513654 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c72d6318734e45e8890bed7246ac8e92"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c72d6318734e45e8890bed7246ac8e92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c72d6318734e45e8890bed7246ac8e92"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c72d6318734e45e8890bed7246ac8e92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 07 09:39:10.513654 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Tenant: tempest-VolumesNegativeTest-625773642 Jun 07 09:39:10.513654 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Tenant-Id: c72d6318734e45e8890bed7246ac8e92 Jun 07 09:39:10.513654 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Tenant-Name: tempest-VolumesNegativeTest-625773642 Jun 07 09:39:10.513654 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User: tempest-VolumesNegativeTest-625773642-project Jun 07 09:39:10.513654 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User-Domain-Id: default Jun 07 09:39:10.513654 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User-Domain-Name: Default Jun 07 09:39:10.513654 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User-Id: a9ec7c5401274c41a1c3a34632f60071 Jun 07 09:39:10.513654 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User-Name: tempest-VolumesNegativeTest-625773642-project Jun 07 09:39:10.513654 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Jun 07 09:39:10.513654 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-50708424", "metadata": {"Type": "work"}}} Jun 07 09:39:10.513654 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: method: Jun 07 09:39:10.513654 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 07 09:39:10.514657 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-50708424', 'metadata': {'Type': 'work'}}}} Jun 07 09:39:10.514657 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 09:39:10.514657 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:39:10.514657 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 07 09:39:10.514657 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 07 09:39:10.514657 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 07 09:39:10.514657 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi raise error Jun 07 09:39:10.514657 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 07 09:39:10.514657 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:39:10.514657 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 07 09:39:10.514657 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 07 09:39:10.514657 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:39:10.514657 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 07 09:39:10.514657 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi '' Jun 07 09:39:10.514657 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:39:10.514657 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:39:10.514657 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:39:10.514657 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:39:10.514657 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:39:10.514657 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:39:10.514657 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 09:39:10.514657 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 09:39:10.516685 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 09:39:10.516685 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 09:39:10.516685 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 09:39:10.516685 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 09:39:10.516685 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 07 09:39:10.516685 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 07 09:39:10.516685 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 07 09:39:10.516685 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 07 09:39:10.516685 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 07 09:39:10.516685 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 07 09:39:10.516685 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 07 09:39:10.516685 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:39:10.516685 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:39:10.516685 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:39:10.516685 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:39:10.516685 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:39:10.516685 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:39:10.516685 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 07 09:39:10.516685 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 07 09:39:10.519185 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 07 09:39:10.519185 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:39:10.519185 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-617e2170-89c5-440c-85d4-d7f16157ffa2 tempest-VolumesNegativeTest-625773642 tempest-VolumesNegativeTest-625773642-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118741) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 09:39:10.519185 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-617e2170-89c5-440c-85d4-d7f16157ffa2 tempest-VolumesNegativeTest-625773642 tempest-VolumesNegativeTest-625773642-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009135 Jun 07 09:39:10.519185 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 528/1056] 10.222.0.57 () {60 vars in 1155 bytes} [Tue Jun 7 09:39:10 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 07 09:39:10.526218 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-a2f21b12-49eb-48dc-aa94-132e849351ce tempest-VolumesNegativeTest-625773642 tempest-VolumesNegativeTest-625773642-project] Calling method '.version_select at 0x7f5c91eb7e50>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:39:10.562048 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.wsgi [None req-a2f21b12-49eb-48dc-aa94-132e849351ce tempest-VolumesNegativeTest-625773642 tempest-VolumesNegativeTest-625773642-project] HTTP exception thrown: Volume tempest-invalid-1018750232 could not be found. Jun 07 09:39:10.563072 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-a2f21b12-49eb-48dc-aa94-132e849351ce tempest-VolumesNegativeTest-625773642 tempest-VolumesNegativeTest-625773642-project] Request method failure captured: Jun 07 09:39:10.563072 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1018750232 HTTP/1.1 Jun 07 09:39:10.563072 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Accept: application/json Jun 07 09:39:10.563072 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Accept-Encoding: identity Jun 07 09:39:10.563072 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Connection: close Jun 07 09:39:10.563072 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Content-Length: 0 Jun 07 09:39:10.563072 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Content-Type: application/json Jun 07 09:39:10.563072 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Host: 10.222.0.57 Jun 07 09:39:10.563072 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Openstack-System-Scope: None Jun 07 09:39:10.563072 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: User-Agent: python-urllib3/1.26.9 Jun 07 09:39:10.563072 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Auth-Token: gAAAAABinxy-fBtsvlDABvxInK_sbLWtcLaIPlf7tJInA8wO6wacp7yvUlGQEiavtswPteZPGBdysDwiQaK8glPeuxlY9Q-1fNbiu20mn13QK8j0z6UisfNHjiWtCJtPTHmsekT-xCr_kxxRU0mns7pfMQG86Aznpjtdd1XBmsxTLX5dwWjw__8 Jun 07 09:39:10.563072 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Domain-Id: None Jun 07 09:39:10.563072 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Domain-Name: None Jun 07 09:39:10.563072 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Identity-Status: Confirmed Jun 07 09:39:10.563072 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Is-Admin-Project: True Jun 07 09:39:10.563072 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Domain-Id: default Jun 07 09:39:10.563072 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Domain-Name: Default Jun 07 09:39:10.563072 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Id: c72d6318734e45e8890bed7246ac8e92 Jun 07 09:39:10.563072 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Name: tempest-VolumesNegativeTest-625773642 Jun 07 09:39:10.563072 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Role: reader,member Jun 07 09:39:10.563072 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Roles: reader,member Jun 07 09:39:10.564709 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c72d6318734e45e8890bed7246ac8e92"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c72d6318734e45e8890bed7246ac8e92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c72d6318734e45e8890bed7246ac8e92"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c72d6318734e45e8890bed7246ac8e92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 07 09:39:10.564709 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Tenant: tempest-VolumesNegativeTest-625773642 Jun 07 09:39:10.564709 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Tenant-Id: c72d6318734e45e8890bed7246ac8e92 Jun 07 09:39:10.564709 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Tenant-Name: tempest-VolumesNegativeTest-625773642 Jun 07 09:39:10.564709 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User: tempest-VolumesNegativeTest-625773642-project Jun 07 09:39:10.564709 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Domain-Id: default Jun 07 09:39:10.564709 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Domain-Name: Default Jun 07 09:39:10.564709 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Id: a9ec7c5401274c41a1c3a34632f60071 Jun 07 09:39:10.564709 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Name: tempest-VolumesNegativeTest-625773642-project Jun 07 09:39:10.564709 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: method: Jun 07 09:39:10.564709 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: exception: Volume tempest-invalid-1018750232 could not be found. Jun 07 09:39:10.564709 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: action_args: {'id': 'tempest-invalid-1018750232'} Jun 07 09:39:10.564709 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 09:39:10.565652 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:39:10.565652 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 09:39:10.565652 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 09:39:10.565652 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 07 09:39:10.565652 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 07 09:39:10.565652 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 07 09:39:10.565652 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 07 09:39:10.565652 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 07 09:39:10.565652 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 07 09:39:10.565652 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 07 09:39:10.565652 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 07 09:39:10.565652 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 09:39:10.565652 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 09:39:10.565652 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 09:39:10.565652 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 09:39:10.565652 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1018750232 could not be found. (HTTP 404) (Request-ID: req-05bf0008-95cc-47ab-b858-9ca22ff1f5f2) Jun 07 09:39:10.565652 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:39:10.565652 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:39:10.565652 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:39:10.567181 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:39:10.567181 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 07 09:39:10.567181 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 07 09:39:10.567181 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 07 09:39:10.567181 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 07 09:39:10.567181 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 07 09:39:10.567181 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 07 09:39:10.567181 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 07 09:39:10.567181 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 07 09:39:10.567181 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 09:39:10.567181 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 09:39:10.567181 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 07 09:39:10.567181 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 07 09:39:10.567181 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 07 09:39:10.567181 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 07 09:39:10.567181 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 07 09:39:10.567181 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 07 09:39:10.567181 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 07 09:39:10.567181 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 07 09:39:10.568673 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 09:39:10.568673 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 09:39:10.568673 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 09:39:10.568673 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 09:39:10.568673 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1018750232 could not be found. Jun 07 09:39:10.568673 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:39:10.568673 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:39:10.568673 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:39:10.568673 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:39:10.568673 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:39:10.568673 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:39:10.568673 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 09:39:10.568673 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 09:39:10.568673 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 09:39:10.568673 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 09:39:10.568673 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 09:39:10.568673 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 09:39:10.568673 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 07 09:39:10.568673 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 09:39:10.568673 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1018750232 could not be found. Jun 07 09:39:10.570327 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:39:10.570327 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:39:10.570327 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:39:10.570327 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:39:10.570327 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:39:10.570327 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:39:10.570327 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 09:39:10.570327 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 09:39:10.570327 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1018750232 could not be found. Jun 07 09:39:10.570327 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:39:10.570327 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-a2f21b12-49eb-48dc-aa94-132e849351ce tempest-VolumesNegativeTest-625773642 tempest-VolumesNegativeTest-625773642-project] Returning 404 to user: Volume tempest-invalid-1018750232 could not be found. {{(pid=118740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 09:39:10.570327 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-a2f21b12-49eb-48dc-aa94-132e849351ce tempest-VolumesNegativeTest-625773642 tempest-VolumesNegativeTest-625773642-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1018750232" status: 404 len: 99 microversion: 2.1 time: 0.041960 Jun 07 09:39:10.570327 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 529/1057] 10.222.0.57 () {58 vars in 1217 bytes} [Tue Jun 7 09:39:10 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1018750232 => generated 99 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 07 09:39:10.575322 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-cb212002-45c2-44fe-85c2-9d6e124c6251 tempest-VolumesNegativeTest-625773642 tempest-VolumesNegativeTest-625773642-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003750 Jun 07 09:39:10.575822 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 529/1058] 10.222.0.57 () {58 vars in 1139 bytes} [Tue Jun 7 09:39:10 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 07 09:39:10.584211 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-af34b008-e01b-4f06-b208-3c20a7e3cfbd tempest-VolumesNegativeTest-625773642 tempest-VolumesNegativeTest-625773642-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003735 Jun 07 09:39:10.584825 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 530/1059] 10.222.0.57 () {58 vars in 1136 bytes} [Tue Jun 7 09:39:10 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 07 09:39:10.593993 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-8be79d55-c54f-48e3-8021-858cbf8cc3d4 tempest-VolumesNegativeTest-625773642 tempest-VolumesNegativeTest-625773642-project] Calling method '.version_select at 0x7f5c932b90d0>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:39:10.622310 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.wsgi [None req-8be79d55-c54f-48e3-8021-858cbf8cc3d4 tempest-VolumesNegativeTest-625773642 tempest-VolumesNegativeTest-625773642-project] HTTP exception thrown: Volume cddda75a-a388-4f8e-bea9-6d4eac8d32b4 could not be found. Jun 07 09:39:10.624267 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-8be79d55-c54f-48e3-8021-858cbf8cc3d4 tempest-VolumesNegativeTest-625773642 tempest-VolumesNegativeTest-625773642-project] Request method failure captured: Jun 07 09:39:10.624267 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: request: DELETE /compute/v2.1/os-volumes/cddda75a-a388-4f8e-bea9-6d4eac8d32b4 HTTP/1.1 Jun 07 09:39:10.624267 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Accept: application/json Jun 07 09:39:10.624267 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Accept-Encoding: identity Jun 07 09:39:10.624267 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Connection: close Jun 07 09:39:10.624267 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Content-Length: 0 Jun 07 09:39:10.624267 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Content-Type: application/json Jun 07 09:39:10.624267 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Host: 10.222.0.57 Jun 07 09:39:10.624267 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Openstack-System-Scope: None Jun 07 09:39:10.624267 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: User-Agent: python-urllib3/1.26.9 Jun 07 09:39:10.624267 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Auth-Token: gAAAAABinxy-fBtsvlDABvxInK_sbLWtcLaIPlf7tJInA8wO6wacp7yvUlGQEiavtswPteZPGBdysDwiQaK8glPeuxlY9Q-1fNbiu20mn13QK8j0z6UisfNHjiWtCJtPTHmsekT-xCr_kxxRU0mns7pfMQG86Aznpjtdd1XBmsxTLX5dwWjw__8 Jun 07 09:39:10.624267 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Domain-Id: None Jun 07 09:39:10.624267 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Domain-Name: None Jun 07 09:39:10.624267 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Identity-Status: Confirmed Jun 07 09:39:10.624267 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Is-Admin-Project: True Jun 07 09:39:10.624267 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Project-Domain-Id: default Jun 07 09:39:10.624267 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Project-Domain-Name: Default Jun 07 09:39:10.624267 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Project-Id: c72d6318734e45e8890bed7246ac8e92 Jun 07 09:39:10.624267 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Project-Name: tempest-VolumesNegativeTest-625773642 Jun 07 09:39:10.624267 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Role: reader,member Jun 07 09:39:10.624267 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Roles: reader,member Jun 07 09:39:10.625916 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c72d6318734e45e8890bed7246ac8e92"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c72d6318734e45e8890bed7246ac8e92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c72d6318734e45e8890bed7246ac8e92"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c72d6318734e45e8890bed7246ac8e92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 07 09:39:10.625916 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Tenant: tempest-VolumesNegativeTest-625773642 Jun 07 09:39:10.625916 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Tenant-Id: c72d6318734e45e8890bed7246ac8e92 Jun 07 09:39:10.625916 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Tenant-Name: tempest-VolumesNegativeTest-625773642 Jun 07 09:39:10.625916 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User: tempest-VolumesNegativeTest-625773642-project Jun 07 09:39:10.625916 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User-Domain-Id: default Jun 07 09:39:10.625916 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User-Domain-Name: Default Jun 07 09:39:10.625916 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User-Id: a9ec7c5401274c41a1c3a34632f60071 Jun 07 09:39:10.625916 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User-Name: tempest-VolumesNegativeTest-625773642-project Jun 07 09:39:10.625916 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: method: Jun 07 09:39:10.625916 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: exception: Volume cddda75a-a388-4f8e-bea9-6d4eac8d32b4 could not be found. Jun 07 09:39:10.625916 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: action_args: {'id': 'cddda75a-a388-4f8e-bea9-6d4eac8d32b4'} Jun 07 09:39:10.625916 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 09:39:10.626920 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:39:10.626920 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 09:39:10.626920 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 09:39:10.626920 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 07 09:39:10.626920 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 07 09:39:10.626920 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 07 09:39:10.626920 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 07 09:39:10.626920 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 07 09:39:10.626920 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 07 09:39:10.626920 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 07 09:39:10.626920 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 07 09:39:10.626920 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 09:39:10.626920 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 09:39:10.626920 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 09:39:10.626920 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 09:39:10.626920 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cddda75a-a388-4f8e-bea9-6d4eac8d32b4 could not be found. (HTTP 404) (Request-ID: req-6afe314a-5740-4363-8e7a-7f530d9af4f7) Jun 07 09:39:10.626920 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:39:10.626920 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:39:10.626920 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:39:10.628306 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:39:10.628306 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 07 09:39:10.628306 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 07 09:39:10.628306 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 07 09:39:10.628306 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 07 09:39:10.628306 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 07 09:39:10.628306 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 07 09:39:10.628306 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 07 09:39:10.628306 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 07 09:39:10.628306 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 09:39:10.628306 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 09:39:10.628306 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 07 09:39:10.628306 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 07 09:39:10.628306 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 07 09:39:10.628306 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 07 09:39:10.628306 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 07 09:39:10.628306 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 07 09:39:10.628306 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 07 09:39:10.628306 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 07 09:39:10.629716 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 09:39:10.629716 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 09:39:10.629716 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 09:39:10.629716 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 09:39:10.629716 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cddda75a-a388-4f8e-bea9-6d4eac8d32b4 could not be found. Jun 07 09:39:10.629716 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:39:10.629716 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:39:10.629716 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:39:10.629716 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:39:10.629716 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:39:10.629716 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:39:10.629716 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 09:39:10.629716 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 09:39:10.629716 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 09:39:10.629716 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 09:39:10.629716 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 09:39:10.629716 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 09:39:10.629716 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 07 09:39:10.629716 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 09:39:10.631166 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume cddda75a-a388-4f8e-bea9-6d4eac8d32b4 could not be found. Jun 07 09:39:10.631166 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:39:10.631166 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:39:10.631166 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:39:10.631166 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:39:10.631166 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:39:10.631166 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:39:10.631166 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 09:39:10.631166 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 09:39:10.631166 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cddda75a-a388-4f8e-bea9-6d4eac8d32b4 could not be found. Jun 07 09:39:10.631166 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:39:10.631166 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-8be79d55-c54f-48e3-8021-858cbf8cc3d4 tempest-VolumesNegativeTest-625773642 tempest-VolumesNegativeTest-625773642-project] Returning 404 to user: Volume cddda75a-a388-4f8e-bea9-6d4eac8d32b4 could not be found. {{(pid=118741) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 09:39:10.631166 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-8be79d55-c54f-48e3-8021-858cbf8cc3d4 tempest-VolumesNegativeTest-625773642 tempest-VolumesNegativeTest-625773642-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/cddda75a-a388-4f8e-bea9-6d4eac8d32b4" status: 404 len: 109 microversion: 2.1 time: 0.035418 Jun 07 09:39:10.631166 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 530/1060] 10.222.0.57 () {58 vars in 1247 bytes} [Tue Jun 7 09:39:10 2022] DELETE /compute/v2.1/os-volumes/cddda75a-a388-4f8e-bea9-6d4eac8d32b4 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 09:39:10.635213 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-a6335ef1-e552-4532-95fd-427b15370e1b tempest-VolumesNegativeTest-625773642 tempest-VolumesNegativeTest-625773642-project] Calling method '.version_select at 0x7f5c91fa20d0>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:39:10.661440 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.wsgi [None req-a6335ef1-e552-4532-95fd-427b15370e1b tempest-VolumesNegativeTest-625773642 tempest-VolumesNegativeTest-625773642-project] HTTP exception thrown: Volume 50cd62dc-403e-4bcc-ae17-3ece5003f80c could not be found. Jun 07 09:39:10.663938 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-a6335ef1-e552-4532-95fd-427b15370e1b tempest-VolumesNegativeTest-625773642 tempest-VolumesNegativeTest-625773642-project] Request method failure captured: Jun 07 09:39:10.663938 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: request: GET /compute/v2.1/os-volumes/50cd62dc-403e-4bcc-ae17-3ece5003f80c HTTP/1.1 Jun 07 09:39:10.663938 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Accept: application/json Jun 07 09:39:10.663938 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Accept-Encoding: identity Jun 07 09:39:10.663938 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Connection: close Jun 07 09:39:10.663938 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Content-Length: 0 Jun 07 09:39:10.663938 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Content-Type: application/json Jun 07 09:39:10.663938 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Host: 10.222.0.57 Jun 07 09:39:10.663938 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Openstack-System-Scope: None Jun 07 09:39:10.663938 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: User-Agent: python-urllib3/1.26.9 Jun 07 09:39:10.663938 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Auth-Token: gAAAAABinxy-fBtsvlDABvxInK_sbLWtcLaIPlf7tJInA8wO6wacp7yvUlGQEiavtswPteZPGBdysDwiQaK8glPeuxlY9Q-1fNbiu20mn13QK8j0z6UisfNHjiWtCJtPTHmsekT-xCr_kxxRU0mns7pfMQG86Aznpjtdd1XBmsxTLX5dwWjw__8 Jun 07 09:39:10.663938 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Domain-Id: None Jun 07 09:39:10.663938 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Domain-Name: None Jun 07 09:39:10.663938 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Identity-Status: Confirmed Jun 07 09:39:10.663938 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Is-Admin-Project: True Jun 07 09:39:10.663938 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Domain-Id: default Jun 07 09:39:10.663938 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Domain-Name: Default Jun 07 09:39:10.663938 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Id: c72d6318734e45e8890bed7246ac8e92 Jun 07 09:39:10.663938 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Name: tempest-VolumesNegativeTest-625773642 Jun 07 09:39:10.663938 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Role: reader,member Jun 07 09:39:10.663938 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Roles: reader,member Jun 07 09:39:10.665614 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c72d6318734e45e8890bed7246ac8e92"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c72d6318734e45e8890bed7246ac8e92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c72d6318734e45e8890bed7246ac8e92"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c72d6318734e45e8890bed7246ac8e92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 07 09:39:10.665614 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Tenant: tempest-VolumesNegativeTest-625773642 Jun 07 09:39:10.665614 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Tenant-Id: c72d6318734e45e8890bed7246ac8e92 Jun 07 09:39:10.665614 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Tenant-Name: tempest-VolumesNegativeTest-625773642 Jun 07 09:39:10.665614 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User: tempest-VolumesNegativeTest-625773642-project Jun 07 09:39:10.665614 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Domain-Id: default Jun 07 09:39:10.665614 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Domain-Name: Default Jun 07 09:39:10.665614 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Id: a9ec7c5401274c41a1c3a34632f60071 Jun 07 09:39:10.665614 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Name: tempest-VolumesNegativeTest-625773642-project Jun 07 09:39:10.665614 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: method: Jun 07 09:39:10.665614 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: exception: Volume 50cd62dc-403e-4bcc-ae17-3ece5003f80c could not be found. Jun 07 09:39:10.665614 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: action_args: {'id': '50cd62dc-403e-4bcc-ae17-3ece5003f80c'} Jun 07 09:39:10.665614 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 09:39:10.667470 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:39:10.667470 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 09:39:10.667470 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 09:39:10.667470 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 07 09:39:10.667470 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 07 09:39:10.667470 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 07 09:39:10.667470 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 07 09:39:10.667470 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 07 09:39:10.667470 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 07 09:39:10.667470 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 07 09:39:10.667470 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 07 09:39:10.667470 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 09:39:10.667470 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 09:39:10.667470 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 09:39:10.667470 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 09:39:10.667470 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 50cd62dc-403e-4bcc-ae17-3ece5003f80c could not be found. (HTTP 404) (Request-ID: req-4421d3bd-036f-42b9-a71d-0b66bafc6bdd) Jun 07 09:39:10.667470 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:39:10.667470 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:39:10.667470 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:39:10.668754 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:39:10.668754 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 07 09:39:10.668754 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 07 09:39:10.668754 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 07 09:39:10.668754 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 07 09:39:10.668754 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 07 09:39:10.668754 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 07 09:39:10.668754 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 07 09:39:10.668754 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 07 09:39:10.668754 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 09:39:10.668754 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 09:39:10.668754 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 07 09:39:10.668754 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 07 09:39:10.668754 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 07 09:39:10.668754 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 07 09:39:10.668754 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 07 09:39:10.668754 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 07 09:39:10.668754 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 07 09:39:10.668754 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 07 09:39:10.669929 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 09:39:10.669929 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 09:39:10.669929 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 09:39:10.669929 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 09:39:10.669929 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 50cd62dc-403e-4bcc-ae17-3ece5003f80c could not be found. Jun 07 09:39:10.669929 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:39:10.669929 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:39:10.669929 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:39:10.669929 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:39:10.669929 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:39:10.669929 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:39:10.669929 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 09:39:10.669929 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 09:39:10.669929 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 09:39:10.669929 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 09:39:10.669929 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 09:39:10.669929 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 09:39:10.669929 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 07 09:39:10.669929 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 09:39:10.671303 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 50cd62dc-403e-4bcc-ae17-3ece5003f80c could not be found. Jun 07 09:39:10.671303 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:39:10.671303 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:39:10.671303 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:39:10.671303 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:39:10.671303 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:39:10.671303 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:39:10.671303 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 09:39:10.671303 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 09:39:10.671303 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 50cd62dc-403e-4bcc-ae17-3ece5003f80c could not be found. Jun 07 09:39:10.671303 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:39:10.671303 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-a6335ef1-e552-4532-95fd-427b15370e1b tempest-VolumesNegativeTest-625773642 tempest-VolumesNegativeTest-625773642-project] Returning 404 to user: Volume 50cd62dc-403e-4bcc-ae17-3ece5003f80c could not be found. {{(pid=118740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 09:39:10.671303 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-a6335ef1-e552-4532-95fd-427b15370e1b tempest-VolumesNegativeTest-625773642 tempest-VolumesNegativeTest-625773642-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/50cd62dc-403e-4bcc-ae17-3ece5003f80c" status: 404 len: 109 microversion: 2.1 time: 0.034060 Jun 07 09:39:10.671303 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 531/1061] 10.222.0.57 () {58 vars in 1244 bytes} [Tue Jun 7 09:39:10 2022] GET /compute/v2.1/os-volumes/50cd62dc-403e-4bcc-ae17-3ece5003f80c => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 07 09:39:42.171865 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-3fc978f5-ef7b-44f2-a328-e22eb9dd7e80 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:39:42.174552 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writing DB stats nova_api:SELECT=17,nova_api:DELETE=1 {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:39:42.175585 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writing DB stats nova_cell1:SELECT=30 {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:39:42.181694 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-3fc978f5-ef7b-44f2-a328-e22eb9dd7e80 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] [instance: dd2acb94-efe3-4c28-b597-21b0cfa1f27d] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:39:42.187880 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1 {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:39:42.188852 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:39:42.194213 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-3fc978f5-ef7b-44f2-a328-e22eb9dd7e80 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:39:42.195772 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-3fc978f5-ef7b-44f2-a328-e22eb9dd7e80 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:39:42.196679 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-3fc978f5-ef7b-44f2-a328-e22eb9dd7e80 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:39:42.203412 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-3fc978f5-ef7b-44f2-a328-e22eb9dd7e80 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:39:42.226271 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-3fc978f5-ef7b-44f2-a328-e22eb9dd7e80 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] [instance: dd2acb94-efe3-4c28-b597-21b0cfa1f27d] Going to try to terminate instance {{(pid=118741) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 09:39:42.307890 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [req-6c3e2e58-e496-4e8e-a91f-7e9c4cbce394 req-240432e6-64ce-4261-b06b-591b03d2c481 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd2acb94-efe3-4c28-b597-21b0cfa1f27d", "tag": "b980d237-cae5-40fe-89ff-abe6de093fce"}]} {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:39:42.316029 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [req-6c3e2e58-e496-4e8e-a91f-7e9c4cbce394 req-240432e6-64ce-4261-b06b-591b03d2c481 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:39:42.316502 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [req-6c3e2e58-e496-4e8e-a91f-7e9c4cbce394 req-240432e6-64ce-4261-b06b-591b03d2c481 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:39:42.326951 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.compute.server_external_events [req-6c3e2e58-e496-4e8e-a91f-7e9c4cbce394 req-240432e6-64ce-4261-b06b-591b03d2c481 service nova] Creating event network-changed:b980d237-cae5-40fe-89ff-abe6de093fce for instance dd2acb94-efe3-4c28-b597-21b0cfa1f27d on hv-cinder-83699 Jun 07 09:39:42.332438 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [req-6c3e2e58-e496-4e8e-a91f-7e9c4cbce394 req-240432e6-64ce-4261-b06b-591b03d2c481 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.158882 Jun 07 09:39:42.333076 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 532/1062] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Jun 7 09:39:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:39:42.522867 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-3fc978f5-ef7b-44f2-a328-e22eb9dd7e80 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] 10.222.0.57 "DELETE /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d" status: 204 len: 0 microversion: 2.1 time: 0.354263 Jun 07 09:39:42.523495 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 531/1063] 10.222.0.57 () {58 vars in 1238 bytes} [Tue Jun 7 09:39:42 2022] DELETE /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 09:39:42.532453 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-c5dcd33a-7bb9-4848-b160-7f8cca2ee5fa tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:39:42.533262 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-c5dcd33a-7bb9-4848-b160-7f8cca2ee5fa tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] [instance: dd2acb94-efe3-4c28-b597-21b0cfa1f27d] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:39:42.540077 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-c5dcd33a-7bb9-4848-b160-7f8cca2ee5fa tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:39:42.540687 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-c5dcd33a-7bb9-4848-b160-7f8cca2ee5fa tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:39:42.541481 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-c5dcd33a-7bb9-4848-b160-7f8cca2ee5fa tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:39:42.541986 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-c5dcd33a-7bb9-4848-b160-7f8cca2ee5fa tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:39:42.674846 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-c5dcd33a-7bb9-4848-b160-7f8cca2ee5fa tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db3cd25f4c94640854677709d10ccbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0e917f30d3430bb088ca3d0afe1a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:39:42.682502 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-c5dcd33a-7bb9-4848-b160-7f8cca2ee5fa tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] 10.222.0.57 "GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d" status: 200 len: 1568 microversion: 2.1 time: 0.154694 Jun 07 09:39:42.683055 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 533/1064] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:39:42 2022] GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:39:43.701875 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-14d94aad-a346-4706-a013-9fc206b1aaa9 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:39:43.702595 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-14d94aad-a346-4706-a013-9fc206b1aaa9 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] [instance: dd2acb94-efe3-4c28-b597-21b0cfa1f27d] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:39:43.710050 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-14d94aad-a346-4706-a013-9fc206b1aaa9 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:39:43.710490 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-14d94aad-a346-4706-a013-9fc206b1aaa9 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:39:43.711238 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-14d94aad-a346-4706-a013-9fc206b1aaa9 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:39:43.711668 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-14d94aad-a346-4706-a013-9fc206b1aaa9 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:39:43.844052 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-14d94aad-a346-4706-a013-9fc206b1aaa9 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db3cd25f4c94640854677709d10ccbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0e917f30d3430bb088ca3d0afe1a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:39:43.852113 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-14d94aad-a346-4706-a013-9fc206b1aaa9 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] 10.222.0.57 "GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d" status: 200 len: 1568 microversion: 2.1 time: 0.154540 Jun 07 09:39:43.858124 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 532/1065] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:39:43 2022] GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:39:44.873426 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-2d2a85d5-f2f6-4446-b79f-26e20331c174 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:39:44.874160 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-2d2a85d5-f2f6-4446-b79f-26e20331c174 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] [instance: dd2acb94-efe3-4c28-b597-21b0cfa1f27d] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:39:44.880724 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-2d2a85d5-f2f6-4446-b79f-26e20331c174 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:39:44.881251 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-2d2a85d5-f2f6-4446-b79f-26e20331c174 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:39:44.882051 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-2d2a85d5-f2f6-4446-b79f-26e20331c174 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:39:44.883116 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-2d2a85d5-f2f6-4446-b79f-26e20331c174 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:39:45.015640 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-2d2a85d5-f2f6-4446-b79f-26e20331c174 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db3cd25f4c94640854677709d10ccbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0e917f30d3430bb088ca3d0afe1a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:39:45.023941 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-2d2a85d5-f2f6-4446-b79f-26e20331c174 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] 10.222.0.57 "GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d" status: 200 len: 1568 microversion: 2.1 time: 0.154427 Jun 07 09:39:45.024498 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 534/1066] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:39:44 2022] GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:39:45.664302 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [req-118d0eb9-af91-4e61-812d-ba4cf73b969d req-d120ef9d-995b-4d51-901b-cabbc9feb0c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd2acb94-efe3-4c28-b597-21b0cfa1f27d", "name": "network-vif-deleted", "tag": "b980d237-cae5-40fe-89ff-abe6de093fce"}]} {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:39:45.673403 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [req-118d0eb9-af91-4e61-812d-ba4cf73b969d req-d120ef9d-995b-4d51-901b-cabbc9feb0c7 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:39:45.673886 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [req-118d0eb9-af91-4e61-812d-ba4cf73b969d req-d120ef9d-995b-4d51-901b-cabbc9feb0c7 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:39:45.686653 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.compute.server_external_events [req-118d0eb9-af91-4e61-812d-ba4cf73b969d req-d120ef9d-995b-4d51-901b-cabbc9feb0c7 service nova] Creating event network-vif-deleted:b980d237-cae5-40fe-89ff-abe6de093fce for instance dd2acb94-efe3-4c28-b597-21b0cfa1f27d on hv-cinder-83699 Jun 07 09:39:45.691720 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [req-118d0eb9-af91-4e61-812d-ba4cf73b969d req-d120ef9d-995b-4d51-901b-cabbc9feb0c7 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032111 Jun 07 09:39:45.692704 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 533/1067] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Jun 7 09:39:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:39:46.041870 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-03c1d122-abc7-4531-af0f-54293149888b tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:39:46.042524 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-03c1d122-abc7-4531-af0f-54293149888b tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] [instance: dd2acb94-efe3-4c28-b597-21b0cfa1f27d] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:39:46.049336 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-03c1d122-abc7-4531-af0f-54293149888b tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:39:46.050107 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-03c1d122-abc7-4531-af0f-54293149888b tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:39:46.050824 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-03c1d122-abc7-4531-af0f-54293149888b tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:39:46.051259 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-03c1d122-abc7-4531-af0f-54293149888b tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:39:46.120780 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-03c1d122-abc7-4531-af0f-54293149888b tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db3cd25f4c94640854677709d10ccbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0e917f30d3430bb088ca3d0afe1a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:39:46.128323 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-03c1d122-abc7-4531-af0f-54293149888b tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] 10.222.0.57 "GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d" status: 200 len: 1220 microversion: 2.1 time: 0.091098 Jun 07 09:39:46.128931 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 535/1068] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:39:46 2022] GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d => generated 1220 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:39:47.146394 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-feaf22bc-8005-4100-84aa-7999088c5689 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:39:47.147596 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-feaf22bc-8005-4100-84aa-7999088c5689 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] [instance: dd2acb94-efe3-4c28-b597-21b0cfa1f27d] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:39:47.171414 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-feaf22bc-8005-4100-84aa-7999088c5689 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:39:47.172077 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-feaf22bc-8005-4100-84aa-7999088c5689 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:39:47.172937 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-feaf22bc-8005-4100-84aa-7999088c5689 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:39:47.173370 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-feaf22bc-8005-4100-84aa-7999088c5689 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:39:47.206531 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-feaf22bc-8005-4100-84aa-7999088c5689 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:39:47.206972 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-feaf22bc-8005-4100-84aa-7999088c5689 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:39:47.207411 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.objects.instance [None req-feaf22bc-8005-4100-84aa-7999088c5689 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lazy-loading 'fault' on Instance uuid dd2acb94-efe3-4c28-b597-21b0cfa1f27d {{(pid=118741) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 09:39:47.261618 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-feaf22bc-8005-4100-84aa-7999088c5689 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db3cd25f4c94640854677709d10ccbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0e917f30d3430bb088ca3d0afe1a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:39:47.269141 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-feaf22bc-8005-4100-84aa-7999088c5689 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] 10.222.0.57 "GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d" status: 200 len: 1225 microversion: 2.1 time: 0.127373 Jun 07 09:39:47.269703 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 534/1069] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:39:47 2022] GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d => generated 1225 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:39:48.287027 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-0e1a34cb-ca25-4432-aff9-980c14b41c75 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:39:48.288322 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-0e1a34cb-ca25-4432-aff9-980c14b41c75 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] [instance: dd2acb94-efe3-4c28-b597-21b0cfa1f27d] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:39:48.294436 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-0e1a34cb-ca25-4432-aff9-980c14b41c75 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:39:48.294921 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-0e1a34cb-ca25-4432-aff9-980c14b41c75 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:39:48.295732 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-0e1a34cb-ca25-4432-aff9-980c14b41c75 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:39:48.296167 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-0e1a34cb-ca25-4432-aff9-980c14b41c75 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:39:48.310170 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.wsgi [None req-0e1a34cb-ca25-4432-aff9-980c14b41c75 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] HTTP exception thrown: Instance dd2acb94-efe3-4c28-b597-21b0cfa1f27d could not be found. Jun 07 09:39:48.311808 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-0e1a34cb-ca25-4432-aff9-980c14b41c75 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Request method failure captured: Jun 07 09:39:48.311808 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: request: GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d HTTP/1.1 Jun 07 09:39:48.311808 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Accept: application/json Jun 07 09:39:48.311808 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Accept-Encoding: identity Jun 07 09:39:48.311808 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Connection: close Jun 07 09:39:48.311808 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Content-Length: 0 Jun 07 09:39:48.311808 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Content-Type: application/json Jun 07 09:39:48.311808 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Host: 10.222.0.57 Jun 07 09:39:48.311808 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Openstack-System-Scope: None Jun 07 09:39:48.311808 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: User-Agent: python-urllib3/1.26.9 Jun 07 09:39:48.311808 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Auth-Token: gAAAAABinxtoI7QiAO2-IOEudc3nd999BxKv6zOHJMnyxsWA76s5Ds06OzUJSVRNONjLCtQAEacIVcjpbjJBGG3t6FWSF_z6eSCIjSt4olyKO5PNSlXubqAhpClR44P26XQ7Urat3tDLdAxX6rOedRooJqZqZUVaayNJIFuEahizsqN-mx4XRbw Jun 07 09:39:48.311808 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Domain-Id: None Jun 07 09:39:48.311808 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Domain-Name: None Jun 07 09:39:48.311808 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Identity-Status: Confirmed Jun 07 09:39:48.311808 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Is-Admin-Project: True Jun 07 09:39:48.311808 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Domain-Id: default Jun 07 09:39:48.311808 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Domain-Name: Default Jun 07 09:39:48.311808 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Id: ae0e917f30d3430bb088ca3d0afe1a02 Jun 07 09:39:48.311808 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Name: tempest-TestShelveInstance-1986953675 Jun 07 09:39:48.311808 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Role: reader,member Jun 07 09:39:48.311808 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Roles: reader,member Jun 07 09:39:48.313541 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ae0e917f30d3430bb088ca3d0afe1a02"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ae0e917f30d3430bb088ca3d0afe1a02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ae0e917f30d3430bb088ca3d0afe1a02"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ae0e917f30d3430bb088ca3d0afe1a02"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 07 09:39:48.313541 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Tenant: tempest-TestShelveInstance-1986953675 Jun 07 09:39:48.313541 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Tenant-Id: ae0e917f30d3430bb088ca3d0afe1a02 Jun 07 09:39:48.313541 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Tenant-Name: tempest-TestShelveInstance-1986953675 Jun 07 09:39:48.313541 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User: tempest-TestShelveInstance-1986953675-project Jun 07 09:39:48.313541 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Domain-Id: default Jun 07 09:39:48.313541 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Domain-Name: Default Jun 07 09:39:48.313541 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Id: 9db3cd25f4c94640854677709d10ccbe Jun 07 09:39:48.313541 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Name: tempest-TestShelveInstance-1986953675-project Jun 07 09:39:48.313541 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: method: > Jun 07 09:39:48.313541 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: exception: Instance dd2acb94-efe3-4c28-b597-21b0cfa1f27d could not be found. Jun 07 09:39:48.313541 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: action_args: {'id': 'dd2acb94-efe3-4c28-b597-21b0cfa1f27d'} Jun 07 09:39:48.314704 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 09:39:48.314704 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:39:48.314704 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 09:39:48.314704 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 09:39:48.314704 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 09:39:48.314704 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 09:39:48.314704 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 09:39:48.314704 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 09:39:48.314704 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 09:39:48.314704 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 09:39:48.314704 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd2acb94-efe3-4c28-b597-21b0cfa1f27d could not be found. Jun 07 09:39:48.314704 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:39:48.314704 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:39:48.314704 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:39:48.314704 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:39:48.314704 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:39:48.314704 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:39:48.314704 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 09:39:48.314704 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 09:39:48.314704 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 09:39:48.316368 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 09:39:48.316368 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 09:39:48.316368 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 09:39:48.316368 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 09:39:48.316368 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 09:39:48.316368 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 09:39:48.316368 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 09:39:48.316368 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd2acb94-efe3-4c28-b597-21b0cfa1f27d could not be found. Jun 07 09:39:48.316368 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:39:48.316368 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:39:48.316368 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:39:48.316368 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:39:48.316368 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:39:48.316368 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:39:48.316368 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 09:39:48.316368 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 09:39:48.316368 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd2acb94-efe3-4c28-b597-21b0cfa1f27d could not be found. Jun 07 09:39:48.316368 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:39:48.317915 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-0e1a34cb-ca25-4432-aff9-980c14b41c75 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Returning 404 to user: Instance dd2acb94-efe3-4c28-b597-21b0cfa1f27d could not be found. {{(pid=118740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 09:39:48.317915 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-0e1a34cb-ca25-4432-aff9-980c14b41c75 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] 10.222.0.57 "GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d" status: 404 len: 111 microversion: 2.1 time: 0.030027 Jun 07 09:39:48.317915 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 536/1070] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:39:48 2022] GET /compute/v2.1/servers/dd2acb94-efe3-4c28-b597-21b0cfa1f27d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 09:39:48.583014 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-da4015af-c35f-4753-ad81-50b53d3fd1a3 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] Calling method '.version_select at 0x7f5c978f8160>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:39:48.700742 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-da4015af-c35f-4753-ad81-50b53d3fd1a3 tempest-TestShelveInstance-1986953675 tempest-TestShelveInstance-1986953675-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2083521930" status: 202 len: 0 microversion: 2.1 time: 0.121428 Jun 07 09:39:48.701335 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 535/1071] 10.222.0.57 () {58 vars in 1253 bytes} [Tue Jun 7 09:39:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2083521930 => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 09:40:04.158801 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 09:40:04.159681 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Tue Jun 7 09:40:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 09:40:05.417829 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writing DB stats nova_api:SELECT=10 {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:40:05.418564 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writing DB stats nova_cell1:SELECT=22 {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:40:05.609915 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-678af335-a64d-488f-af9a-9a14d982c9ad tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Action: 'create', calling method: .version_select at 0x7f5c921853a0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-259675010", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOlmabaP8afwiZviWGTEcb4wI18+jpHH0ex3CzuspJKkWn9xR3iFcvxLjucMQC+rLRiSu/AH+QQsUzGPUt34qmm/sL4xT5nyZPYwHJu0tNn8SZ74pKKybmge8vmCpSxBsg=="}} {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:40:05.623823 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.quota [None req-678af335-a64d-488f-af9a-9a14d982c9ad tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Getting quotas for project 8c26e375cbb2421b8c8e34653f7d2f38. Resources: {'key_pairs'} {{(pid=118740) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 09:40:05.627731 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.quota [None req-678af335-a64d-488f-af9a-9a14d982c9ad tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Getting quotas for user a446f2a301a04fa485094d7be5219a07 and project 8c26e375cbb2421b8c8e34653f7d2f38. Resources: {'key_pairs'} {{(pid=118740) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 09:40:05.742983 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-678af335-a64d-488f-af9a-9a14d982c9ad tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.322268 Jun 07 09:40:05.742983 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 537/1072] 10.222.0.57 () {60 vars in 1158 bytes} [Tue Jun 7 09:40:05 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:40:08.056103 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:40:08.060270 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:40:08.061315 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-7edee521-98f4-4be0-be68-4172fae7d24a tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-311382703", "imageRef": "8fdb0275-8c58-4c9e-a2f3-3aae3a947526", "flavorRef": "452", "networks": [{"uuid": "04c29b11-1bb5-4f3c-90d9-666f7df2218f"}]}} {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:40:08.115554 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.network.neutron [None req-7edee521-98f4-4be0-be68-4172fae7d24a tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] validate_networks() for [('04c29b11-1bb5-4f3c-90d9-666f7df2218f', None, None, None, None, None)] {{(pid=118741) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 09:40:08.664733 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.virt.hardware [None req-7edee521-98f4-4be0-be68-4172fae7d24a tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Flavor limits 0:0:0 {{(pid=118741) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 09:40:08.665190 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.virt.hardware [None req-7edee521-98f4-4be0-be68-4172fae7d24a tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Image limits 0:0:0 {{(pid=118741) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 09:40:08.665659 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.virt.hardware [None req-7edee521-98f4-4be0-be68-4172fae7d24a tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Flavor pref 0:0:0 {{(pid=118741) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 09:40:08.666256 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.virt.hardware [None req-7edee521-98f4-4be0-be68-4172fae7d24a tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Image pref 0:0:0 {{(pid=118741) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 09:40:08.666669 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.virt.hardware [None req-7edee521-98f4-4be0-be68-4172fae7d24a tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118741) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 09:40:08.679626 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-7edee521-98f4-4be0-be68-4172fae7d24a tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:40:08.680464 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-7edee521-98f4-4be0-be68-4172fae7d24a tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:40:08.681443 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-7edee521-98f4-4be0-be68-4172fae7d24a tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:40:08.682002 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-7edee521-98f4-4be0-be68-4172fae7d24a tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:40:08.703705 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.quota [None req-7edee521-98f4-4be0-be68-4172fae7d24a tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Getting quotas for project a0a185c667b14f19aee6427e4f91af8d. Resources: {'instances', 'cores', 'ram'} {{(pid=118741) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 09:40:08.710359 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.quota [None req-7edee521-98f4-4be0-be68-4172fae7d24a tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Getting quotas for user 2e99a37e30d547b992b4ede147f684a4 and project a0a185c667b14f19aee6427e4f91af8d. Resources: {'instances', 'cores', 'ram'} {{(pid=118741) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 09:40:08.724807 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-7edee521-98f4-4be0-be68-4172fae7d24a tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Going to run 1 instances... {{(pid=118741) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 09:40:08.727668 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-7edee521-98f4-4be0-be68-4172fae7d24a tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] [instance: 6ffa64c5-ec10-4935-bfbc-b8e191f6564f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8fdb0275-8c58-4c9e-a2f3-3aae3a947526',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118741) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 09:40:08.927829 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-7edee521-98f4-4be0-be68-4172fae7d24a tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.872865 Jun 07 09:40:08.928486 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 536/1073] 10.222.0.57 () {60 vars in 1146 bytes} [Tue Jun 7 09:40:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 874 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 09:40:08.939241 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-58ba18d8-06bc-4d54-ada3-01cea9ce2de7 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:40:08.939910 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-58ba18d8-06bc-4d54-ada3-01cea9ce2de7 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] [instance: 6ffa64c5-ec10-4935-bfbc-b8e191f6564f] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:40:09.010253 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-58ba18d8-06bc-4d54-ada3-01cea9ce2de7 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e99a37e30d547b992b4ede147f684a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a185c667b14f19aee6427e4f91af8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:40:09.030478 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-58ba18d8-06bc-4d54-ada3-01cea9ce2de7 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] 10.222.0.57 "GET /compute/v2.1/servers/6ffa64c5-ec10-4935-bfbc-b8e191f6564f" status: 200 len: 1218 microversion: 2.1 time: 0.093557 Jun 07 09:40:09.031093 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 538/1074] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:40:08 2022] GET /compute/v2.1/servers/6ffa64c5-ec10-4935-bfbc-b8e191f6564f => generated 1218 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:40:10.048748 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-8c9f8343-30b9-47ff-91af-8d07c019aa32 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:40:10.049381 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-8c9f8343-30b9-47ff-91af-8d07c019aa32 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] [instance: 6ffa64c5-ec10-4935-bfbc-b8e191f6564f] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:40:10.114098 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-8c9f8343-30b9-47ff-91af-8d07c019aa32 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e99a37e30d547b992b4ede147f684a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a185c667b14f19aee6427e4f91af8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:40:10.118821 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-8c9f8343-30b9-47ff-91af-8d07c019aa32 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] 10.222.0.57 "GET /compute/v2.1/servers/6ffa64c5-ec10-4935-bfbc-b8e191f6564f" status: 200 len: 1218 microversion: 2.1 time: 0.075280 Jun 07 09:40:10.128914 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 537/1075] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:40:10 2022] GET /compute/v2.1/servers/6ffa64c5-ec10-4935-bfbc-b8e191f6564f => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:40:11.135677 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-3bda9cf2-9378-4030-b535-f44ef5bed1c3 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:40:11.136231 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-3bda9cf2-9378-4030-b535-f44ef5bed1c3 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] [instance: 6ffa64c5-ec10-4935-bfbc-b8e191f6564f] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:40:11.188791 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-3bda9cf2-9378-4030-b535-f44ef5bed1c3 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e99a37e30d547b992b4ede147f684a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a185c667b14f19aee6427e4f91af8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:40:11.196058 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-3bda9cf2-9378-4030-b535-f44ef5bed1c3 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] 10.222.0.57 "GET /compute/v2.1/servers/6ffa64c5-ec10-4935-bfbc-b8e191f6564f" status: 200 len: 1218 microversion: 2.1 time: 0.064279 Jun 07 09:40:11.196791 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 539/1076] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:40:11 2022] GET /compute/v2.1/servers/6ffa64c5-ec10-4935-bfbc-b8e191f6564f => generated 1218 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:40:12.213884 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-eea96e9e-b163-4c9d-9fdf-40fb98c4e1e7 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:40:12.214507 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-eea96e9e-b163-4c9d-9fdf-40fb98c4e1e7 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] [instance: 6ffa64c5-ec10-4935-bfbc-b8e191f6564f] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:40:12.270133 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-eea96e9e-b163-4c9d-9fdf-40fb98c4e1e7 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e99a37e30d547b992b4ede147f684a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a185c667b14f19aee6427e4f91af8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:40:12.277975 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-eea96e9e-b163-4c9d-9fdf-40fb98c4e1e7 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] 10.222.0.57 "GET /compute/v2.1/servers/6ffa64c5-ec10-4935-bfbc-b8e191f6564f" status: 200 len: 1218 microversion: 2.1 time: 0.068558 Jun 07 09:40:12.278545 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 538/1077] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:40:12 2022] GET /compute/v2.1/servers/6ffa64c5-ec10-4935-bfbc-b8e191f6564f => generated 1218 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:40:13.295015 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-1dc6cada-2a9f-4afc-912a-5bb882b99198 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:40:13.295628 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-1dc6cada-2a9f-4afc-912a-5bb882b99198 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] [instance: 6ffa64c5-ec10-4935-bfbc-b8e191f6564f] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:40:13.302917 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-1dc6cada-2a9f-4afc-912a-5bb882b99198 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:40:13.303925 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-1dc6cada-2a9f-4afc-912a-5bb882b99198 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:40:13.304730 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-1dc6cada-2a9f-4afc-912a-5bb882b99198 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:40:13.305174 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-1dc6cada-2a9f-4afc-912a-5bb882b99198 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:40:13.379754 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-1dc6cada-2a9f-4afc-912a-5bb882b99198 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e99a37e30d547b992b4ede147f684a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a185c667b14f19aee6427e4f91af8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:40:13.388667 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-1dc6cada-2a9f-4afc-912a-5bb882b99198 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] 10.222.0.57 "GET /compute/v2.1/servers/6ffa64c5-ec10-4935-bfbc-b8e191f6564f" status: 200 len: 1222 microversion: 2.1 time: 0.097863 Jun 07 09:40:13.389424 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 540/1078] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:40:13 2022] GET /compute/v2.1/servers/6ffa64c5-ec10-4935-bfbc-b8e191f6564f => generated 1222 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:40:14.405778 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-1f5e5cd2-eee2-4630-bd6c-eaa36427d481 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:40:14.406392 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-1f5e5cd2-eee2-4630-bd6c-eaa36427d481 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] [instance: 6ffa64c5-ec10-4935-bfbc-b8e191f6564f] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:40:14.413594 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-1f5e5cd2-eee2-4630-bd6c-eaa36427d481 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:40:14.414051 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-1f5e5cd2-eee2-4630-bd6c-eaa36427d481 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:40:14.414825 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-1f5e5cd2-eee2-4630-bd6c-eaa36427d481 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:40:14.415263 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-1f5e5cd2-eee2-4630-bd6c-eaa36427d481 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:40:14.481462 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-1f5e5cd2-eee2-4630-bd6c-eaa36427d481 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e99a37e30d547b992b4ede147f684a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a185c667b14f19aee6427e4f91af8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:40:14.490026 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-1f5e5cd2-eee2-4630-bd6c-eaa36427d481 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] 10.222.0.57 "GET /compute/v2.1/servers/6ffa64c5-ec10-4935-bfbc-b8e191f6564f" status: 200 len: 1222 microversion: 2.1 time: 0.088047 Jun 07 09:40:14.490589 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 539/1079] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:40:14 2022] GET /compute/v2.1/servers/6ffa64c5-ec10-4935-bfbc-b8e191f6564f => generated 1222 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:40:15.512376 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-64b3a3b2-36b1-4a1d-85d0-270a87237a10 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:40:15.515053 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-64b3a3b2-36b1-4a1d-85d0-270a87237a10 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] [instance: 6ffa64c5-ec10-4935-bfbc-b8e191f6564f] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:40:15.523124 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-64b3a3b2-36b1-4a1d-85d0-270a87237a10 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:40:15.523719 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-64b3a3b2-36b1-4a1d-85d0-270a87237a10 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:40:15.524575 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-64b3a3b2-36b1-4a1d-85d0-270a87237a10 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:40:15.525091 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-64b3a3b2-36b1-4a1d-85d0-270a87237a10 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:40:15.592981 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-64b3a3b2-36b1-4a1d-85d0-270a87237a10 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e99a37e30d547b992b4ede147f684a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a185c667b14f19aee6427e4f91af8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:40:15.601355 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-64b3a3b2-36b1-4a1d-85d0-270a87237a10 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] 10.222.0.57 "GET /compute/v2.1/servers/6ffa64c5-ec10-4935-bfbc-b8e191f6564f" status: 200 len: 1278 microversion: 2.1 time: 0.097222 Jun 07 09:40:15.602228 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 541/1080] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:40:15 2022] GET /compute/v2.1/servers/6ffa64c5-ec10-4935-bfbc-b8e191f6564f => generated 1278 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:40:16.619260 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-1d490dec-4a24-4819-b145-a69b2b7b2f16 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:40:16.620006 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-1d490dec-4a24-4819-b145-a69b2b7b2f16 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] [instance: 6ffa64c5-ec10-4935-bfbc-b8e191f6564f] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:40:16.631650 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-1d490dec-4a24-4819-b145-a69b2b7b2f16 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:40:16.632207 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-1d490dec-4a24-4819-b145-a69b2b7b2f16 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:40:16.633090 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-1d490dec-4a24-4819-b145-a69b2b7b2f16 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:40:16.633570 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-1d490dec-4a24-4819-b145-a69b2b7b2f16 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:40:16.875656 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-1d490dec-4a24-4819-b145-a69b2b7b2f16 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e99a37e30d547b992b4ede147f684a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a185c667b14f19aee6427e4f91af8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:40:16.884333 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-1d490dec-4a24-4819-b145-a69b2b7b2f16 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] 10.222.0.57 "GET /compute/v2.1/servers/6ffa64c5-ec10-4935-bfbc-b8e191f6564f" status: 200 len: 1318 microversion: 2.1 time: 0.268888 Jun 07 09:40:16.885522 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 540/1081] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:40:16 2022] GET /compute/v2.1/servers/6ffa64c5-ec10-4935-bfbc-b8e191f6564f => generated 1318 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:40:17.405209 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [req-26893647-afbd-4192-9ec8-e18b60c4cf38 req-1c374b2a-6bef-4532-8fc3-8b09b030a8ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ffa64c5-ec10-4935-bfbc-b8e191f6564f", "tag": "6fbefa79-2cf7-4b95-a3d6-2760e3aba098"}]} {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:40:17.416369 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [req-26893647-afbd-4192-9ec8-e18b60c4cf38 req-1c374b2a-6bef-4532-8fc3-8b09b030a8ac service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:40:17.417053 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [req-26893647-afbd-4192-9ec8-e18b60c4cf38 req-1c374b2a-6bef-4532-8fc3-8b09b030a8ac service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:40:17.429308 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.compute.server_external_events [req-26893647-afbd-4192-9ec8-e18b60c4cf38 req-1c374b2a-6bef-4532-8fc3-8b09b030a8ac service nova] Creating event network-changed:6fbefa79-2cf7-4b95-a3d6-2760e3aba098 for instance 6ffa64c5-ec10-4935-bfbc-b8e191f6564f on hv-cinder-83699 Jun 07 09:40:17.434397 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [req-26893647-afbd-4192-9ec8-e18b60c4cf38 req-1c374b2a-6bef-4532-8fc3-8b09b030a8ac service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033225 Jun 07 09:40:17.435113 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 542/1082] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Jun 7 09:40:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:40:17.903987 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-7a66c0e2-08af-493b-8ada-61e6a0b61f1d tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:40:17.907576 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-7a66c0e2-08af-493b-8ada-61e6a0b61f1d tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] [instance: 6ffa64c5-ec10-4935-bfbc-b8e191f6564f] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:40:17.914241 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-7a66c0e2-08af-493b-8ada-61e6a0b61f1d tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:40:17.915067 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-7a66c0e2-08af-493b-8ada-61e6a0b61f1d tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:40:17.916063 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-7a66c0e2-08af-493b-8ada-61e6a0b61f1d tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:40:17.916776 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-7a66c0e2-08af-493b-8ada-61e6a0b61f1d tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:40:18.416207 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-7a66c0e2-08af-493b-8ada-61e6a0b61f1d tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e99a37e30d547b992b4ede147f684a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a185c667b14f19aee6427e4f91af8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:40:18.423909 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-7a66c0e2-08af-493b-8ada-61e6a0b61f1d tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] 10.222.0.57 "GET /compute/v2.1/servers/6ffa64c5-ec10-4935-bfbc-b8e191f6564f" status: 200 len: 1318 microversion: 2.1 time: 0.524092 Jun 07 09:40:18.424573 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 541/1083] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:40:17 2022] GET /compute/v2.1/servers/6ffa64c5-ec10-4935-bfbc-b8e191f6564f => generated 1318 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:40:19.442599 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-73c8509f-b593-49f4-88ae-12380dfe7dc0 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:40:19.443346 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-73c8509f-b593-49f4-88ae-12380dfe7dc0 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] [instance: 6ffa64c5-ec10-4935-bfbc-b8e191f6564f] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:40:19.449907 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-73c8509f-b593-49f4-88ae-12380dfe7dc0 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:40:19.450362 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-73c8509f-b593-49f4-88ae-12380dfe7dc0 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:40:19.451156 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-73c8509f-b593-49f4-88ae-12380dfe7dc0 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:40:19.451595 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-73c8509f-b593-49f4-88ae-12380dfe7dc0 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:40:19.590799 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-73c8509f-b593-49f4-88ae-12380dfe7dc0 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e99a37e30d547b992b4ede147f684a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a185c667b14f19aee6427e4f91af8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:40:19.598361 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-73c8509f-b593-49f4-88ae-12380dfe7dc0 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] 10.222.0.57 "GET /compute/v2.1/servers/6ffa64c5-ec10-4935-bfbc-b8e191f6564f" status: 200 len: 1318 microversion: 2.1 time: 0.160487 Jun 07 09:40:19.599373 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 543/1084] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:40:19 2022] GET /compute/v2.1/servers/6ffa64c5-ec10-4935-bfbc-b8e191f6564f => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:40:20.616644 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-90021941-acd8-4312-8549-b30a1adfeb9a tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:40:20.617269 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-90021941-acd8-4312-8549-b30a1adfeb9a tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] [instance: 6ffa64c5-ec10-4935-bfbc-b8e191f6564f] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:40:20.619168 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writing DB stats nova_cell0:SELECT=2 {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:40:20.624511 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-90021941-acd8-4312-8549-b30a1adfeb9a tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:40:20.625001 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-90021941-acd8-4312-8549-b30a1adfeb9a tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:40:20.625770 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-90021941-acd8-4312-8549-b30a1adfeb9a tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:40:20.626213 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-90021941-acd8-4312-8549-b30a1adfeb9a tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:40:20.821690 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-90021941-acd8-4312-8549-b30a1adfeb9a tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e99a37e30d547b992b4ede147f684a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a185c667b14f19aee6427e4f91af8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:40:20.829263 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-90021941-acd8-4312-8549-b30a1adfeb9a tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] 10.222.0.57 "GET /compute/v2.1/servers/6ffa64c5-ec10-4935-bfbc-b8e191f6564f" status: 200 len: 1318 microversion: 2.1 time: 0.217005 Jun 07 09:40:20.829833 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 542/1085] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:40:20 2022] GET /compute/v2.1/servers/6ffa64c5-ec10-4935-bfbc-b8e191f6564f => generated 1318 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:40:21.846948 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-0f23a714-65db-4c29-910e-4b99a5a4dfe3 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:40:21.850913 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-0f23a714-65db-4c29-910e-4b99a5a4dfe3 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] [instance: 6ffa64c5-ec10-4935-bfbc-b8e191f6564f] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:40:21.850913 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writing DB stats nova_cell0:SELECT=8 {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:40:21.855452 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-0f23a714-65db-4c29-910e-4b99a5a4dfe3 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:40:21.855913 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-0f23a714-65db-4c29-910e-4b99a5a4dfe3 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:40:21.856835 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-0f23a714-65db-4c29-910e-4b99a5a4dfe3 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:40:21.857281 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-0f23a714-65db-4c29-910e-4b99a5a4dfe3 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:40:21.987713 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-0f23a714-65db-4c29-910e-4b99a5a4dfe3 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e99a37e30d547b992b4ede147f684a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a185c667b14f19aee6427e4f91af8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:40:21.995056 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-0f23a714-65db-4c29-910e-4b99a5a4dfe3 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] 10.222.0.57 "GET /compute/v2.1/servers/6ffa64c5-ec10-4935-bfbc-b8e191f6564f" status: 200 len: 1318 microversion: 2.1 time: 0.152188 Jun 07 09:40:21.995613 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 544/1086] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:40:21 2022] GET /compute/v2.1/servers/6ffa64c5-ec10-4935-bfbc-b8e191f6564f => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:40:23.014811 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-f52a9eaa-4940-4c66-9e45-0417486c385d tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:40:23.014811 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-f52a9eaa-4940-4c66-9e45-0417486c385d tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] [instance: 6ffa64c5-ec10-4935-bfbc-b8e191f6564f] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:40:23.014811 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writing DB stats nova_cell0:SELECT=10 {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:40:23.019683 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-f52a9eaa-4940-4c66-9e45-0417486c385d tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:40:23.020128 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-f52a9eaa-4940-4c66-9e45-0417486c385d tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:40:23.021042 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-f52a9eaa-4940-4c66-9e45-0417486c385d tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:40:23.021477 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-f52a9eaa-4940-4c66-9e45-0417486c385d tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:40:23.151098 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-f52a9eaa-4940-4c66-9e45-0417486c385d tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e99a37e30d547b992b4ede147f684a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a185c667b14f19aee6427e4f91af8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:40:23.158500 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-f52a9eaa-4940-4c66-9e45-0417486c385d tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] 10.222.0.57 "GET /compute/v2.1/servers/6ffa64c5-ec10-4935-bfbc-b8e191f6564f" status: 200 len: 1318 microversion: 2.1 time: 0.150570 Jun 07 09:40:23.159100 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 543/1087] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:40:23 2022] GET /compute/v2.1/servers/6ffa64c5-ec10-4935-bfbc-b8e191f6564f => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:40:24.175112 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-5b501ad2-f663-4478-95a8-70bc44535833 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:40:24.175730 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-5b501ad2-f663-4478-95a8-70bc44535833 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] [instance: 6ffa64c5-ec10-4935-bfbc-b8e191f6564f] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:40:24.183284 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-5b501ad2-f663-4478-95a8-70bc44535833 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:40:24.183757 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-5b501ad2-f663-4478-95a8-70bc44535833 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:40:24.184555 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-5b501ad2-f663-4478-95a8-70bc44535833 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:40:24.185043 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-5b501ad2-f663-4478-95a8-70bc44535833 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:40:24.317148 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-5b501ad2-f663-4478-95a8-70bc44535833 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e99a37e30d547b992b4ede147f684a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a185c667b14f19aee6427e4f91af8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:40:24.324623 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-5b501ad2-f663-4478-95a8-70bc44535833 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] 10.222.0.57 "GET /compute/v2.1/servers/6ffa64c5-ec10-4935-bfbc-b8e191f6564f" status: 200 len: 1318 microversion: 2.1 time: 0.153476 Jun 07 09:40:24.325371 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 545/1088] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:40:24 2022] GET /compute/v2.1/servers/6ffa64c5-ec10-4935-bfbc-b8e191f6564f => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:40:25.341524 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-9d779cb5-ce36-4c32-a27e-bc8fe08914d8 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:40:25.342144 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-9d779cb5-ce36-4c32-a27e-bc8fe08914d8 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] [instance: 6ffa64c5-ec10-4935-bfbc-b8e191f6564f] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:40:25.348767 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-9d779cb5-ce36-4c32-a27e-bc8fe08914d8 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:40:25.349218 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-9d779cb5-ce36-4c32-a27e-bc8fe08914d8 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:40:25.350582 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-9d779cb5-ce36-4c32-a27e-bc8fe08914d8 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:40:25.351768 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-9d779cb5-ce36-4c32-a27e-bc8fe08914d8 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:40:25.477206 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-9d779cb5-ce36-4c32-a27e-bc8fe08914d8 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e99a37e30d547b992b4ede147f684a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a185c667b14f19aee6427e4f91af8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:40:25.485162 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-9d779cb5-ce36-4c32-a27e-bc8fe08914d8 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] 10.222.0.57 "GET /compute/v2.1/servers/6ffa64c5-ec10-4935-bfbc-b8e191f6564f" status: 200 len: 1318 microversion: 2.1 time: 0.147341 Jun 07 09:40:25.485734 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 544/1089] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:40:25 2022] GET /compute/v2.1/servers/6ffa64c5-ec10-4935-bfbc-b8e191f6564f => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:40:26.501784 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-2456487e-1a6f-46a9-9364-7902fad0f613 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:40:26.502394 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-2456487e-1a6f-46a9-9364-7902fad0f613 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] [instance: 6ffa64c5-ec10-4935-bfbc-b8e191f6564f] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:40:26.509360 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-2456487e-1a6f-46a9-9364-7902fad0f613 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:40:26.509805 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-2456487e-1a6f-46a9-9364-7902fad0f613 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:40:26.510555 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-2456487e-1a6f-46a9-9364-7902fad0f613 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:40:26.510986 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-2456487e-1a6f-46a9-9364-7902fad0f613 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:40:26.635574 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-2456487e-1a6f-46a9-9364-7902fad0f613 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e99a37e30d547b992b4ede147f684a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a185c667b14f19aee6427e4f91af8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:40:26.642828 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-2456487e-1a6f-46a9-9364-7902fad0f613 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] 10.222.0.57 "GET /compute/v2.1/servers/6ffa64c5-ec10-4935-bfbc-b8e191f6564f" status: 200 len: 1318 microversion: 2.1 time: 0.144802 Jun 07 09:40:26.643382 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 546/1090] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:40:26 2022] GET /compute/v2.1/servers/6ffa64c5-ec10-4935-bfbc-b8e191f6564f => generated 1318 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:40:26.741050 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 09:40:26.741201 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Tue Jun 7 09:40:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 09:40:27.659429 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-f2d55a08-b108-41fc-a386-4ef0a7aa1cea tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:40:27.659964 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-f2d55a08-b108-41fc-a386-4ef0a7aa1cea tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] [instance: 6ffa64c5-ec10-4935-bfbc-b8e191f6564f] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:40:27.666966 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-f2d55a08-b108-41fc-a386-4ef0a7aa1cea tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:40:27.667409 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-f2d55a08-b108-41fc-a386-4ef0a7aa1cea tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:40:27.669443 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-f2d55a08-b108-41fc-a386-4ef0a7aa1cea tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:40:27.669443 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-f2d55a08-b108-41fc-a386-4ef0a7aa1cea tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:40:27.799779 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-f2d55a08-b108-41fc-a386-4ef0a7aa1cea tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e99a37e30d547b992b4ede147f684a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a185c667b14f19aee6427e4f91af8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:40:27.807771 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-f2d55a08-b108-41fc-a386-4ef0a7aa1cea tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] 10.222.0.57 "GET /compute/v2.1/servers/6ffa64c5-ec10-4935-bfbc-b8e191f6564f" status: 200 len: 1318 microversion: 2.1 time: 0.152467 Jun 07 09:40:27.808334 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 545/1091] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:40:27 2022] GET /compute/v2.1/servers/6ffa64c5-ec10-4935-bfbc-b8e191f6564f => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:40:28.824405 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-dbc86fb7-3f3e-49de-a666-d4603d33bf8c tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:40:28.825055 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-dbc86fb7-3f3e-49de-a666-d4603d33bf8c tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] [instance: 6ffa64c5-ec10-4935-bfbc-b8e191f6564f] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:40:28.831592 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-dbc86fb7-3f3e-49de-a666-d4603d33bf8c tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:40:28.832041 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-dbc86fb7-3f3e-49de-a666-d4603d33bf8c tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:40:28.832845 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-dbc86fb7-3f3e-49de-a666-d4603d33bf8c tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:40:28.833286 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-dbc86fb7-3f3e-49de-a666-d4603d33bf8c tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:40:28.961459 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-dbc86fb7-3f3e-49de-a666-d4603d33bf8c tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e99a37e30d547b992b4ede147f684a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a185c667b14f19aee6427e4f91af8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:40:28.968868 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-dbc86fb7-3f3e-49de-a666-d4603d33bf8c tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] 10.222.0.57 "GET /compute/v2.1/servers/6ffa64c5-ec10-4935-bfbc-b8e191f6564f" status: 200 len: 1318 microversion: 2.1 time: 0.148330 Jun 07 09:40:28.969425 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 547/1092] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:40:28 2022] GET /compute/v2.1/servers/6ffa64c5-ec10-4935-bfbc-b8e191f6564f => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:40:29.986522 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-7b563cb5-5711-4b25-b148-d090d74c5071 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:40:29.987071 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-7b563cb5-5711-4b25-b148-d090d74c5071 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] [instance: 6ffa64c5-ec10-4935-bfbc-b8e191f6564f] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:40:29.994123 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-7b563cb5-5711-4b25-b148-d090d74c5071 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:40:29.994573 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-7b563cb5-5711-4b25-b148-d090d74c5071 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:40:29.995330 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-7b563cb5-5711-4b25-b148-d090d74c5071 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:40:29.995766 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-7b563cb5-5711-4b25-b148-d090d74c5071 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:40:30.123182 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-7b563cb5-5711-4b25-b148-d090d74c5071 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e99a37e30d547b992b4ede147f684a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a185c667b14f19aee6427e4f91af8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:40:30.130672 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-7b563cb5-5711-4b25-b148-d090d74c5071 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] 10.222.0.57 "GET /compute/v2.1/servers/6ffa64c5-ec10-4935-bfbc-b8e191f6564f" status: 200 len: 1318 microversion: 2.1 time: 0.148038 Jun 07 09:40:30.131227 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 546/1093] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:40:29 2022] GET /compute/v2.1/servers/6ffa64c5-ec10-4935-bfbc-b8e191f6564f => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:40:31.147882 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-43d23468-b0fd-425c-b9d3-ca09ed8780c2 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:40:31.148491 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-43d23468-b0fd-425c-b9d3-ca09ed8780c2 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] [instance: 6ffa64c5-ec10-4935-bfbc-b8e191f6564f] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:40:31.155165 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-43d23468-b0fd-425c-b9d3-ca09ed8780c2 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:40:31.155612 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-43d23468-b0fd-425c-b9d3-ca09ed8780c2 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:40:31.156377 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-43d23468-b0fd-425c-b9d3-ca09ed8780c2 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:40:31.156840 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-43d23468-b0fd-425c-b9d3-ca09ed8780c2 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:40:31.292361 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-43d23468-b0fd-425c-b9d3-ca09ed8780c2 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e99a37e30d547b992b4ede147f684a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a185c667b14f19aee6427e4f91af8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:40:31.300885 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-43d23468-b0fd-425c-b9d3-ca09ed8780c2 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] 10.222.0.57 "GET /compute/v2.1/servers/6ffa64c5-ec10-4935-bfbc-b8e191f6564f" status: 200 len: 1318 microversion: 2.1 time: 0.157407 Jun 07 09:40:31.301635 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 548/1094] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:40:31 2022] GET /compute/v2.1/servers/6ffa64c5-ec10-4935-bfbc-b8e191f6564f => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:40:31.337689 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [req-61f8dafb-f6be-4848-89cc-ca1971e9165a req-b60eeedf-2733-494d-82bf-62f8c36dd1d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ffa64c5-ec10-4935-bfbc-b8e191f6564f", "name": "network-vif-plugged", "status": "completed", "tag": "6fbefa79-2cf7-4b95-a3d6-2760e3aba098"}]} {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:40:31.346540 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [req-61f8dafb-f6be-4848-89cc-ca1971e9165a req-b60eeedf-2733-494d-82bf-62f8c36dd1d9 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:40:31.347001 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [req-61f8dafb-f6be-4848-89cc-ca1971e9165a req-b60eeedf-2733-494d-82bf-62f8c36dd1d9 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:40:31.359137 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.compute.server_external_events [req-61f8dafb-f6be-4848-89cc-ca1971e9165a req-b60eeedf-2733-494d-82bf-62f8c36dd1d9 service nova] Creating event network-vif-plugged:6fbefa79-2cf7-4b95-a3d6-2760e3aba098 for instance 6ffa64c5-ec10-4935-bfbc-b8e191f6564f on hv-cinder-83699 Jun 07 09:40:31.364295 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [req-61f8dafb-f6be-4848-89cc-ca1971e9165a req-b60eeedf-2733-494d-82bf-62f8c36dd1d9 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163929 Jun 07 09:40:31.364955 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 547/1095] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Jun 7 09:40:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 09:40:32.317553 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-bd2b5018-4ab0-4dc2-b4b7-c8258c97462b tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:40:32.318114 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-bd2b5018-4ab0-4dc2-b4b7-c8258c97462b tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] [instance: 6ffa64c5-ec10-4935-bfbc-b8e191f6564f] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:40:32.324607 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-bd2b5018-4ab0-4dc2-b4b7-c8258c97462b tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:40:32.325079 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-bd2b5018-4ab0-4dc2-b4b7-c8258c97462b tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:40:32.325833 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-bd2b5018-4ab0-4dc2-b4b7-c8258c97462b tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:40:32.326266 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-bd2b5018-4ab0-4dc2-b4b7-c8258c97462b tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:40:32.450177 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-bd2b5018-4ab0-4dc2-b4b7-c8258c97462b tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e99a37e30d547b992b4ede147f684a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a185c667b14f19aee6427e4f91af8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:40:32.457485 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-bd2b5018-4ab0-4dc2-b4b7-c8258c97462b tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] 10.222.0.57 "GET /compute/v2.1/servers/6ffa64c5-ec10-4935-bfbc-b8e191f6564f" status: 200 len: 1318 microversion: 2.1 time: 0.143810 Jun 07 09:40:32.458042 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 549/1096] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:40:32 2022] GET /compute/v2.1/servers/6ffa64c5-ec10-4935-bfbc-b8e191f6564f => generated 1318 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:40:33.475583 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-7e2fc25e-9dcc-4baf-acad-2e608145e254 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:40:33.476291 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-7e2fc25e-9dcc-4baf-acad-2e608145e254 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] [instance: 6ffa64c5-ec10-4935-bfbc-b8e191f6564f] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:40:33.482531 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-7e2fc25e-9dcc-4baf-acad-2e608145e254 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:40:33.482983 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-7e2fc25e-9dcc-4baf-acad-2e608145e254 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:40:33.483749 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-7e2fc25e-9dcc-4baf-acad-2e608145e254 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:40:33.484188 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-7e2fc25e-9dcc-4baf-acad-2e608145e254 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:40:33.612795 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-7e2fc25e-9dcc-4baf-acad-2e608145e254 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e99a37e30d547b992b4ede147f684a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a185c667b14f19aee6427e4f91af8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:40:33.620008 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-7e2fc25e-9dcc-4baf-acad-2e608145e254 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] 10.222.0.57 "GET /compute/v2.1/servers/6ffa64c5-ec10-4935-bfbc-b8e191f6564f" status: 200 len: 1318 microversion: 2.1 time: 0.150080 Jun 07 09:40:33.620564 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 548/1097] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:40:33 2022] GET /compute/v2.1/servers/6ffa64c5-ec10-4935-bfbc-b8e191f6564f => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:40:34.636760 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-0e2811f2-26a9-40f4-be8b-707443d0f5a5 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:40:34.637430 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-0e2811f2-26a9-40f4-be8b-707443d0f5a5 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] [instance: 6ffa64c5-ec10-4935-bfbc-b8e191f6564f] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:40:34.643764 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-0e2811f2-26a9-40f4-be8b-707443d0f5a5 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:40:34.644213 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-0e2811f2-26a9-40f4-be8b-707443d0f5a5 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:40:34.645003 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-0e2811f2-26a9-40f4-be8b-707443d0f5a5 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:40:34.645444 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-0e2811f2-26a9-40f4-be8b-707443d0f5a5 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:40:34.778315 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-0e2811f2-26a9-40f4-be8b-707443d0f5a5 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e99a37e30d547b992b4ede147f684a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a185c667b14f19aee6427e4f91af8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:40:34.782849 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-0e2811f2-26a9-40f4-be8b-707443d0f5a5 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] 10.222.0.57 "GET /compute/v2.1/servers/6ffa64c5-ec10-4935-bfbc-b8e191f6564f" status: 200 len: 1318 microversion: 2.1 time: 0.149970 Jun 07 09:40:34.783399 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 550/1098] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:40:34 2022] GET /compute/v2.1/servers/6ffa64c5-ec10-4935-bfbc-b8e191f6564f => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:40:35.799867 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-5b8af551-8d42-4465-81dc-26017957016c tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:40:35.800481 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-5b8af551-8d42-4465-81dc-26017957016c tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] [instance: 6ffa64c5-ec10-4935-bfbc-b8e191f6564f] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:40:35.807470 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-5b8af551-8d42-4465-81dc-26017957016c tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:40:35.807921 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-5b8af551-8d42-4465-81dc-26017957016c tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:40:35.808726 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-5b8af551-8d42-4465-81dc-26017957016c tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:40:35.809162 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-5b8af551-8d42-4465-81dc-26017957016c tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:40:35.935732 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-5b8af551-8d42-4465-81dc-26017957016c tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e99a37e30d547b992b4ede147f684a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a185c667b14f19aee6427e4f91af8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:40:35.943090 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-5b8af551-8d42-4465-81dc-26017957016c tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] 10.222.0.57 "GET /compute/v2.1/servers/6ffa64c5-ec10-4935-bfbc-b8e191f6564f" status: 200 len: 1318 microversion: 2.1 time: 0.147012 Jun 07 09:40:35.943674 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 549/1099] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:40:35 2022] GET /compute/v2.1/servers/6ffa64c5-ec10-4935-bfbc-b8e191f6564f => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:40:36.960145 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-dbad4a4c-93e4-40be-b304-31dd568d4739 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:40:36.960787 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-dbad4a4c-93e4-40be-b304-31dd568d4739 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] [instance: 6ffa64c5-ec10-4935-bfbc-b8e191f6564f] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:40:36.967214 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-dbad4a4c-93e4-40be-b304-31dd568d4739 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:40:36.967663 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-dbad4a4c-93e4-40be-b304-31dd568d4739 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:40:36.968421 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-dbad4a4c-93e4-40be-b304-31dd568d4739 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:40:36.968890 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-dbad4a4c-93e4-40be-b304-31dd568d4739 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:40:37.097298 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-dbad4a4c-93e4-40be-b304-31dd568d4739 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e99a37e30d547b992b4ede147f684a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a185c667b14f19aee6427e4f91af8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:40:37.105480 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-dbad4a4c-93e4-40be-b304-31dd568d4739 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] 10.222.0.57 "GET /compute/v2.1/servers/6ffa64c5-ec10-4935-bfbc-b8e191f6564f" status: 200 len: 1318 microversion: 2.1 time: 0.149227 Jun 07 09:40:37.106035 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 551/1100] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:40:36 2022] GET /compute/v2.1/servers/6ffa64c5-ec10-4935-bfbc-b8e191f6564f => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:40:38.122679 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-85129d87-2207-4f46-bbbd-e1fe266526fb tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:40:38.123329 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-85129d87-2207-4f46-bbbd-e1fe266526fb tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] [instance: 6ffa64c5-ec10-4935-bfbc-b8e191f6564f] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:40:38.129907 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-85129d87-2207-4f46-bbbd-e1fe266526fb tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:40:38.130361 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-85129d87-2207-4f46-bbbd-e1fe266526fb tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:40:38.131747 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-85129d87-2207-4f46-bbbd-e1fe266526fb tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:40:38.132187 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-85129d87-2207-4f46-bbbd-e1fe266526fb tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:40:38.259572 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-85129d87-2207-4f46-bbbd-e1fe266526fb tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e99a37e30d547b992b4ede147f684a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a185c667b14f19aee6427e4f91af8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:40:38.267177 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-85129d87-2207-4f46-bbbd-e1fe266526fb tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] 10.222.0.57 "GET /compute/v2.1/servers/6ffa64c5-ec10-4935-bfbc-b8e191f6564f" status: 200 len: 1507 microversion: 2.1 time: 0.148438 Jun 07 09:40:38.267683 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 550/1101] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:40:38 2022] GET /compute/v2.1/servers/6ffa64c5-ec10-4935-bfbc-b8e191f6564f => generated 1507 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:40:43.270243 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-3536b1db-207c-4e02-9938-7563de7713c8 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-763609029", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-259675010", "security_groups": [{"name": "tempest-secgroup-smoke-1705282998"}], "block_device_mapping_v2": [{"uuid": "116199cb-2a91-4339-aad9-176a722c0226", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b3a7cead-e268-4715-a95d-aacec80a9aad"}]}} {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:40:43.280455 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=1 {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:40:43.386532 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.network.neutron [None req-3536b1db-207c-4e02-9938-7563de7713c8 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] validate_networks() for [('b3a7cead-e268-4715-a95d-aacec80a9aad', None, None, None, None, None)] {{(pid=118740) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 09:40:43.885453 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.virt.hardware [None req-3536b1db-207c-4e02-9938-7563de7713c8 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Flavor limits 0:0:0 {{(pid=118740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 09:40:43.886072 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.virt.hardware [None req-3536b1db-207c-4e02-9938-7563de7713c8 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Image limits 0:0:0 {{(pid=118740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 09:40:43.886549 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.virt.hardware [None req-3536b1db-207c-4e02-9938-7563de7713c8 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Flavor pref 0:0:0 {{(pid=118740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 09:40:43.886959 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.virt.hardware [None req-3536b1db-207c-4e02-9938-7563de7713c8 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Image pref 0:0:0 {{(pid=118740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 09:40:43.887396 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.virt.hardware [None req-3536b1db-207c-4e02-9938-7563de7713c8 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 09:40:43.896785 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-3536b1db-207c-4e02-9938-7563de7713c8 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:40:43.897243 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-3536b1db-207c-4e02-9938-7563de7713c8 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:40:43.898060 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-3536b1db-207c-4e02-9938-7563de7713c8 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:40:43.898504 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-3536b1db-207c-4e02-9938-7563de7713c8 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:40:43.905545 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writing DB stats nova_cell1:SELECT=69 {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:40:43.920906 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.quota [None req-3536b1db-207c-4e02-9938-7563de7713c8 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Getting quotas for project 8c26e375cbb2421b8c8e34653f7d2f38. Resources: {'instances', 'cores', 'ram'} {{(pid=118740) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 09:40:43.920906 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.quota [None req-3536b1db-207c-4e02-9938-7563de7713c8 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Getting quotas for user a446f2a301a04fa485094d7be5219a07 and project 8c26e375cbb2421b8c8e34653f7d2f38. Resources: {'instances', 'cores', 'ram'} {{(pid=118740) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 09:40:43.980327 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-3536b1db-207c-4e02-9938-7563de7713c8 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Going to run 1 instances... {{(pid=118740) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 09:40:43.982718 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-3536b1db-207c-4e02-9938-7563de7713c8 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] [instance: ce52be6b-b276-423b-8b23-c76ff0ae73ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='116199cb-2a91-4339-aad9-176a722c0226',volume_size=None,volume_type=None)] {{(pid=118740) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 09:40:44.347231 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-3536b1db-207c-4e02-9938-7563de7713c8 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.080765 Jun 07 09:40:44.347940 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 552/1102] 10.222.0.57 () {60 vars in 1146 bytes} [Tue Jun 7 09:40:43 2022] POST /compute/v2.1/servers => generated 406 bytes in 1082 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 09:40:44.358635 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-ea558f32-a056-4645-b7d4-0177ba00026e tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:40:44.359286 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-ea558f32-a056-4645-b7d4-0177ba00026e tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] [instance: ce52be6b-b276-423b-8b23-c76ff0ae73ae] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:40:44.361803 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:40:44.417001 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-ea558f32-a056-4645-b7d4-0177ba00026e tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a446f2a301a04fa485094d7be5219a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c26e375cbb2421b8c8e34653f7d2f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:40:44.424063 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-ea558f32-a056-4645-b7d4-0177ba00026e tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] 10.222.0.57 "GET /compute/v2.1/servers/ce52be6b-b276-423b-8b23-c76ff0ae73ae" status: 200 len: 1093 microversion: 2.1 time: 0.069326 Jun 07 09:40:44.427671 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 551/1103] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:40:44 2022] GET /compute/v2.1/servers/ce52be6b-b276-423b-8b23-c76ff0ae73ae => generated 1093 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:40:45.441888 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-49b2e2a7-4fd4-4c63-972b-6e9ac363987b tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:40:45.443174 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-49b2e2a7-4fd4-4c63-972b-6e9ac363987b tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] [instance: ce52be6b-b276-423b-8b23-c76ff0ae73ae] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:40:45.497364 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-49b2e2a7-4fd4-4c63-972b-6e9ac363987b tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a446f2a301a04fa485094d7be5219a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c26e375cbb2421b8c8e34653f7d2f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:40:45.504187 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-49b2e2a7-4fd4-4c63-972b-6e9ac363987b tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] 10.222.0.57 "GET /compute/v2.1/servers/ce52be6b-b276-423b-8b23-c76ff0ae73ae" status: 200 len: 1093 microversion: 2.1 time: 0.066060 Jun 07 09:40:45.504828 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 553/1104] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:40:45 2022] GET /compute/v2.1/servers/ce52be6b-b276-423b-8b23-c76ff0ae73ae => generated 1093 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:40:46.522100 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-dc54b6e6-b91d-441a-8f8d-4e6acf06e645 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:40:46.523744 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-dc54b6e6-b91d-441a-8f8d-4e6acf06e645 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] [instance: ce52be6b-b276-423b-8b23-c76ff0ae73ae] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:40:46.531023 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-dc54b6e6-b91d-441a-8f8d-4e6acf06e645 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:40:46.531481 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-dc54b6e6-b91d-441a-8f8d-4e6acf06e645 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:40:46.532257 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-dc54b6e6-b91d-441a-8f8d-4e6acf06e645 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:40:46.532725 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-dc54b6e6-b91d-441a-8f8d-4e6acf06e645 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:40:46.535808 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writing DB stats nova_cell1:SELECT=71 {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:40:46.655873 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-dc54b6e6-b91d-441a-8f8d-4e6acf06e645 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a446f2a301a04fa485094d7be5219a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c26e375cbb2421b8c8e34653f7d2f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:40:46.664199 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-dc54b6e6-b91d-441a-8f8d-4e6acf06e645 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] 10.222.0.57 "GET /compute/v2.1/servers/ce52be6b-b276-423b-8b23-c76ff0ae73ae" status: 200 len: 1199 microversion: 2.1 time: 0.146662 Jun 07 09:40:46.664816 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 552/1105] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:40:46 2022] GET /compute/v2.1/servers/ce52be6b-b276-423b-8b23-c76ff0ae73ae => generated 1199 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:40:47.682529 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-ec59fd25-bf88-449d-843d-da2f5e908c4c tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:40:47.683936 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-ec59fd25-bf88-449d-843d-da2f5e908c4c tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] [instance: ce52be6b-b276-423b-8b23-c76ff0ae73ae] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:40:47.691557 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-ec59fd25-bf88-449d-843d-da2f5e908c4c tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:40:47.692090 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-ec59fd25-bf88-449d-843d-da2f5e908c4c tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:40:47.693149 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-ec59fd25-bf88-449d-843d-da2f5e908c4c tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:40:47.693583 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-ec59fd25-bf88-449d-843d-da2f5e908c4c tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:40:47.847688 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-ec59fd25-bf88-449d-843d-da2f5e908c4c tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a446f2a301a04fa485094d7be5219a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c26e375cbb2421b8c8e34653f7d2f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:40:47.855836 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-ec59fd25-bf88-449d-843d-da2f5e908c4c tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] 10.222.0.57 "GET /compute/v2.1/servers/ce52be6b-b276-423b-8b23-c76ff0ae73ae" status: 200 len: 1277 microversion: 2.1 time: 0.177278 Jun 07 09:40:47.860630 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 554/1106] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:40:47 2022] GET /compute/v2.1/servers/ce52be6b-b276-423b-8b23-c76ff0ae73ae => generated 1277 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:40:48.560054 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [req-7df24cb7-0227-41c4-9fb2-91c63ea67d4f req-b39b2171-2df1-4f05-92dc-91e346884064 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce52be6b-b276-423b-8b23-c76ff0ae73ae", "tag": "4e651f94-a4d4-4193-97e0-1431e700765a"}]} {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:40:48.571278 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [req-7df24cb7-0227-41c4-9fb2-91c63ea67d4f req-b39b2171-2df1-4f05-92dc-91e346884064 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:40:48.571755 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [req-7df24cb7-0227-41c4-9fb2-91c63ea67d4f req-b39b2171-2df1-4f05-92dc-91e346884064 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:40:48.584648 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.compute.server_external_events [req-7df24cb7-0227-41c4-9fb2-91c63ea67d4f req-b39b2171-2df1-4f05-92dc-91e346884064 service nova] Creating event network-changed:4e651f94-a4d4-4193-97e0-1431e700765a for instance ce52be6b-b276-423b-8b23-c76ff0ae73ae on hv-cinder-83699 Jun 07 09:40:48.590059 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [req-7df24cb7-0227-41c4-9fb2-91c63ea67d4f req-b39b2171-2df1-4f05-92dc-91e346884064 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034637 Jun 07 09:40:48.605739 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 553/1107] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Jun 7 09:40:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:40:48.878722 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-b9ed055c-f2e4-4d75-a54b-5210269bdc96 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:40:48.879367 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-b9ed055c-f2e4-4d75-a54b-5210269bdc96 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] [instance: ce52be6b-b276-423b-8b23-c76ff0ae73ae] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:40:48.886466 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b9ed055c-f2e4-4d75-a54b-5210269bdc96 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:40:48.886924 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b9ed055c-f2e4-4d75-a54b-5210269bdc96 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:40:48.887707 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b9ed055c-f2e4-4d75-a54b-5210269bdc96 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:40:48.888186 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b9ed055c-f2e4-4d75-a54b-5210269bdc96 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:40:49.029025 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-b9ed055c-f2e4-4d75-a54b-5210269bdc96 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a446f2a301a04fa485094d7be5219a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c26e375cbb2421b8c8e34653f7d2f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:40:49.037507 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-b9ed055c-f2e4-4d75-a54b-5210269bdc96 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] 10.222.0.57 "GET /compute/v2.1/servers/ce52be6b-b276-423b-8b23-c76ff0ae73ae" status: 200 len: 1265 microversion: 2.1 time: 0.162509 Jun 07 09:40:49.038423 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 555/1108] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:40:48 2022] GET /compute/v2.1/servers/ce52be6b-b276-423b-8b23-c76ff0ae73ae => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:40:50.059858 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-58650aa9-a725-4314-915c-de102690e92a tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:40:50.060553 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-58650aa9-a725-4314-915c-de102690e92a tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] [instance: ce52be6b-b276-423b-8b23-c76ff0ae73ae] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:40:50.066738 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-58650aa9-a725-4314-915c-de102690e92a tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:40:50.067182 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-58650aa9-a725-4314-915c-de102690e92a tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:40:50.067934 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-58650aa9-a725-4314-915c-de102690e92a tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:40:50.069022 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-58650aa9-a725-4314-915c-de102690e92a tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:40:50.210920 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-58650aa9-a725-4314-915c-de102690e92a tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a446f2a301a04fa485094d7be5219a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c26e375cbb2421b8c8e34653f7d2f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:40:50.218394 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-58650aa9-a725-4314-915c-de102690e92a tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] 10.222.0.57 "GET /compute/v2.1/servers/ce52be6b-b276-423b-8b23-c76ff0ae73ae" status: 200 len: 1265 microversion: 2.1 time: 0.163715 Jun 07 09:40:50.218950 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 554/1109] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:40:50 2022] GET /compute/v2.1/servers/ce52be6b-b276-423b-8b23-c76ff0ae73ae => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:40:51.236185 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-3e6d8000-2e10-4a39-b5f6-1a760203f29a tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:40:51.236823 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-3e6d8000-2e10-4a39-b5f6-1a760203f29a tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] [instance: ce52be6b-b276-423b-8b23-c76ff0ae73ae] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:40:51.243766 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-3e6d8000-2e10-4a39-b5f6-1a760203f29a tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:40:51.244215 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-3e6d8000-2e10-4a39-b5f6-1a760203f29a tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:40:51.245068 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-3e6d8000-2e10-4a39-b5f6-1a760203f29a tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:40:51.245594 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-3e6d8000-2e10-4a39-b5f6-1a760203f29a tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:40:51.378409 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-3e6d8000-2e10-4a39-b5f6-1a760203f29a tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a446f2a301a04fa485094d7be5219a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c26e375cbb2421b8c8e34653f7d2f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:40:51.386667 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-3e6d8000-2e10-4a39-b5f6-1a760203f29a tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] 10.222.0.57 "GET /compute/v2.1/servers/ce52be6b-b276-423b-8b23-c76ff0ae73ae" status: 200 len: 1265 microversion: 2.1 time: 0.154253 Jun 07 09:40:51.387302 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 556/1110] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:40:51 2022] GET /compute/v2.1/servers/ce52be6b-b276-423b-8b23-c76ff0ae73ae => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:40:52.403412 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-669d5c7a-7bab-4c07-a9d4-a4da08ac2d43 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:40:52.403933 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-669d5c7a-7bab-4c07-a9d4-a4da08ac2d43 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] [instance: ce52be6b-b276-423b-8b23-c76ff0ae73ae] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:40:52.410459 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-669d5c7a-7bab-4c07-a9d4-a4da08ac2d43 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:40:52.410912 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-669d5c7a-7bab-4c07-a9d4-a4da08ac2d43 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:40:52.412251 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-669d5c7a-7bab-4c07-a9d4-a4da08ac2d43 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:40:52.412730 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-669d5c7a-7bab-4c07-a9d4-a4da08ac2d43 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:40:52.546324 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-669d5c7a-7bab-4c07-a9d4-a4da08ac2d43 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a446f2a301a04fa485094d7be5219a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c26e375cbb2421b8c8e34653f7d2f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:40:52.555463 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-669d5c7a-7bab-4c07-a9d4-a4da08ac2d43 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] 10.222.0.57 "GET /compute/v2.1/servers/ce52be6b-b276-423b-8b23-c76ff0ae73ae" status: 200 len: 1265 microversion: 2.1 time: 0.154955 Jun 07 09:40:52.555463 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 555/1111] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:40:52 2022] GET /compute/v2.1/servers/ce52be6b-b276-423b-8b23-c76ff0ae73ae => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:40:53.571819 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-eadf5ea4-7617-4d81-9b1d-907424929c6e tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:40:53.572348 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-eadf5ea4-7617-4d81-9b1d-907424929c6e tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] [instance: ce52be6b-b276-423b-8b23-c76ff0ae73ae] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:40:53.578825 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-eadf5ea4-7617-4d81-9b1d-907424929c6e tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:40:53.579271 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-eadf5ea4-7617-4d81-9b1d-907424929c6e tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:40:53.580036 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-eadf5ea4-7617-4d81-9b1d-907424929c6e tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:40:53.580467 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-eadf5ea4-7617-4d81-9b1d-907424929c6e tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:40:53.707070 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-eadf5ea4-7617-4d81-9b1d-907424929c6e tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a446f2a301a04fa485094d7be5219a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c26e375cbb2421b8c8e34653f7d2f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:40:53.714508 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-eadf5ea4-7617-4d81-9b1d-907424929c6e tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] 10.222.0.57 "GET /compute/v2.1/servers/ce52be6b-b276-423b-8b23-c76ff0ae73ae" status: 200 len: 1265 microversion: 2.1 time: 0.147331 Jun 07 09:40:53.715073 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 557/1112] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:40:53 2022] GET /compute/v2.1/servers/ce52be6b-b276-423b-8b23-c76ff0ae73ae => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:40:54.731874 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-be4578e3-bb85-4809-9510-73115e019aac tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:40:54.732417 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-be4578e3-bb85-4809-9510-73115e019aac tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] [instance: ce52be6b-b276-423b-8b23-c76ff0ae73ae] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:40:54.734877 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writing DB stats nova_cell0:SELECT=2 {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:40:54.739805 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-be4578e3-bb85-4809-9510-73115e019aac tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:40:54.740291 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-be4578e3-bb85-4809-9510-73115e019aac tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:40:54.741090 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-be4578e3-bb85-4809-9510-73115e019aac tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:40:54.741523 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-be4578e3-bb85-4809-9510-73115e019aac tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:40:54.874741 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-be4578e3-bb85-4809-9510-73115e019aac tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a446f2a301a04fa485094d7be5219a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c26e375cbb2421b8c8e34653f7d2f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:40:54.882585 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-be4578e3-bb85-4809-9510-73115e019aac tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] 10.222.0.57 "GET /compute/v2.1/servers/ce52be6b-b276-423b-8b23-c76ff0ae73ae" status: 200 len: 1265 microversion: 2.1 time: 0.154775 Jun 07 09:40:54.883142 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 556/1113] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:40:54 2022] GET /compute/v2.1/servers/ce52be6b-b276-423b-8b23-c76ff0ae73ae => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:40:55.899701 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-6baa351a-5904-4e49-850b-9d88da585810 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:40:55.900322 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-6baa351a-5904-4e49-850b-9d88da585810 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] [instance: ce52be6b-b276-423b-8b23-c76ff0ae73ae] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:40:55.902165 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writing DB stats nova_cell0:SELECT=2 {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:40:55.903305 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writing DB stats nova_cell0:SELECT=8 {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:40:55.908200 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-6baa351a-5904-4e49-850b-9d88da585810 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:40:55.908687 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-6baa351a-5904-4e49-850b-9d88da585810 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:40:55.909458 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-6baa351a-5904-4e49-850b-9d88da585810 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:40:55.910088 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-6baa351a-5904-4e49-850b-9d88da585810 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:40:56.043574 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-6baa351a-5904-4e49-850b-9d88da585810 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a446f2a301a04fa485094d7be5219a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c26e375cbb2421b8c8e34653f7d2f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:40:56.051293 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-6baa351a-5904-4e49-850b-9d88da585810 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] 10.222.0.57 "GET /compute/v2.1/servers/ce52be6b-b276-423b-8b23-c76ff0ae73ae" status: 200 len: 1265 microversion: 2.1 time: 0.156060 Jun 07 09:40:56.051855 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 558/1114] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:40:55 2022] GET /compute/v2.1/servers/ce52be6b-b276-423b-8b23-c76ff0ae73ae => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:40:57.067303 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-5a035397-9513-4abf-81e1-4e2257f4dee9 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:40:57.067912 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-5a035397-9513-4abf-81e1-4e2257f4dee9 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] [instance: ce52be6b-b276-423b-8b23-c76ff0ae73ae] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:40:57.074633 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-5a035397-9513-4abf-81e1-4e2257f4dee9 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:40:57.075222 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-5a035397-9513-4abf-81e1-4e2257f4dee9 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:40:57.076023 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-5a035397-9513-4abf-81e1-4e2257f4dee9 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:40:57.076482 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-5a035397-9513-4abf-81e1-4e2257f4dee9 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:40:57.208768 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-5a035397-9513-4abf-81e1-4e2257f4dee9 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a446f2a301a04fa485094d7be5219a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c26e375cbb2421b8c8e34653f7d2f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:40:57.216349 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-5a035397-9513-4abf-81e1-4e2257f4dee9 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] 10.222.0.57 "GET /compute/v2.1/servers/ce52be6b-b276-423b-8b23-c76ff0ae73ae" status: 200 len: 1265 microversion: 2.1 time: 0.152970 Jun 07 09:40:57.217087 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 557/1115] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:40:57 2022] GET /compute/v2.1/servers/ce52be6b-b276-423b-8b23-c76ff0ae73ae => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:40:58.234124 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-69ce99cf-0be1-46ca-a01a-1fd6b5d2a28c tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:40:58.234764 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-69ce99cf-0be1-46ca-a01a-1fd6b5d2a28c tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] [instance: ce52be6b-b276-423b-8b23-c76ff0ae73ae] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:40:58.241255 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-69ce99cf-0be1-46ca-a01a-1fd6b5d2a28c tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:40:58.241707 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-69ce99cf-0be1-46ca-a01a-1fd6b5d2a28c tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:40:58.242466 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-69ce99cf-0be1-46ca-a01a-1fd6b5d2a28c tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:40:58.242904 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-69ce99cf-0be1-46ca-a01a-1fd6b5d2a28c tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:40:58.370900 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-69ce99cf-0be1-46ca-a01a-1fd6b5d2a28c tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a446f2a301a04fa485094d7be5219a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c26e375cbb2421b8c8e34653f7d2f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:40:58.378523 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-69ce99cf-0be1-46ca-a01a-1fd6b5d2a28c tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] 10.222.0.57 "GET /compute/v2.1/servers/ce52be6b-b276-423b-8b23-c76ff0ae73ae" status: 200 len: 1265 microversion: 2.1 time: 0.148271 Jun 07 09:40:58.379358 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 559/1116] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:40:58 2022] GET /compute/v2.1/servers/ce52be6b-b276-423b-8b23-c76ff0ae73ae => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:40:59.320471 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [req-5e4d1187-4657-4015-a999-487ecfaee67e req-6286b936-6966-4184-bc54-5d48fd2f6db5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce52be6b-b276-423b-8b23-c76ff0ae73ae", "name": "network-vif-plugged", "status": "completed", "tag": "4e651f94-a4d4-4193-97e0-1431e700765a"}]} {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:40:59.325483 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [req-5e4d1187-4657-4015-a999-487ecfaee67e req-6286b936-6966-4184-bc54-5d48fd2f6db5 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:40:59.325919 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [req-5e4d1187-4657-4015-a999-487ecfaee67e req-6286b936-6966-4184-bc54-5d48fd2f6db5 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:40:59.337135 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.compute.server_external_events [req-5e4d1187-4657-4015-a999-487ecfaee67e req-6286b936-6966-4184-bc54-5d48fd2f6db5 service nova] Creating event network-vif-plugged:4e651f94-a4d4-4193-97e0-1431e700765a for instance ce52be6b-b276-423b-8b23-c76ff0ae73ae on hv-cinder-83699 Jun 07 09:40:59.342183 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [req-5e4d1187-4657-4015-a999-487ecfaee67e req-6286b936-6966-4184-bc54-5d48fd2f6db5 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029039 Jun 07 09:40:59.345379 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 558/1117] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Jun 7 09:40:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:40:59.395478 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-d4f07bdc-64f8-43c3-92c0-58f97083853a tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:40:59.396096 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-d4f07bdc-64f8-43c3-92c0-58f97083853a tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] [instance: ce52be6b-b276-423b-8b23-c76ff0ae73ae] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:40:59.403321 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-d4f07bdc-64f8-43c3-92c0-58f97083853a tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:40:59.403775 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-d4f07bdc-64f8-43c3-92c0-58f97083853a tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:40:59.404553 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-d4f07bdc-64f8-43c3-92c0-58f97083853a tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:40:59.405025 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-d4f07bdc-64f8-43c3-92c0-58f97083853a tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:40:59.540175 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-d4f07bdc-64f8-43c3-92c0-58f97083853a tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a446f2a301a04fa485094d7be5219a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c26e375cbb2421b8c8e34653f7d2f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:40:59.547402 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-d4f07bdc-64f8-43c3-92c0-58f97083853a tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] 10.222.0.57 "GET /compute/v2.1/servers/ce52be6b-b276-423b-8b23-c76ff0ae73ae" status: 200 len: 1265 microversion: 2.1 time: 0.155955 Jun 07 09:40:59.547959 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 560/1118] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:40:59 2022] GET /compute/v2.1/servers/ce52be6b-b276-423b-8b23-c76ff0ae73ae => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:41:00.565334 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-f991d314-d4ca-4997-ac63-95cbcbc8c4d7 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:41:00.566033 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-f991d314-d4ca-4997-ac63-95cbcbc8c4d7 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] [instance: ce52be6b-b276-423b-8b23-c76ff0ae73ae] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:41:00.572793 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-f991d314-d4ca-4997-ac63-95cbcbc8c4d7 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:41:00.573274 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-f991d314-d4ca-4997-ac63-95cbcbc8c4d7 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:41:00.574030 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-f991d314-d4ca-4997-ac63-95cbcbc8c4d7 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:41:00.574464 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-f991d314-d4ca-4997-ac63-95cbcbc8c4d7 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:41:00.703008 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-f991d314-d4ca-4997-ac63-95cbcbc8c4d7 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a446f2a301a04fa485094d7be5219a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c26e375cbb2421b8c8e34653f7d2f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:41:00.710915 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-f991d314-d4ca-4997-ac63-95cbcbc8c4d7 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] 10.222.0.57 "GET /compute/v2.1/servers/ce52be6b-b276-423b-8b23-c76ff0ae73ae" status: 200 len: 1265 microversion: 2.1 time: 0.149832 Jun 07 09:41:00.711477 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 559/1119] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:41:00 2022] GET /compute/v2.1/servers/ce52be6b-b276-423b-8b23-c76ff0ae73ae => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:41:01.728451 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-5548f425-a5f1-4050-9d81-52717f40dad7 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:41:01.729008 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-5548f425-a5f1-4050-9d81-52717f40dad7 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] [instance: ce52be6b-b276-423b-8b23-c76ff0ae73ae] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:41:01.735457 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-5548f425-a5f1-4050-9d81-52717f40dad7 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:41:01.735907 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-5548f425-a5f1-4050-9d81-52717f40dad7 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:41:01.736695 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-5548f425-a5f1-4050-9d81-52717f40dad7 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:41:01.737165 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-5548f425-a5f1-4050-9d81-52717f40dad7 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:41:01.866057 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-5548f425-a5f1-4050-9d81-52717f40dad7 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a446f2a301a04fa485094d7be5219a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c26e375cbb2421b8c8e34653f7d2f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:41:01.873512 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-5548f425-a5f1-4050-9d81-52717f40dad7 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] 10.222.0.57 "GET /compute/v2.1/servers/ce52be6b-b276-423b-8b23-c76ff0ae73ae" status: 200 len: 1452 microversion: 2.1 time: 0.149622 Jun 07 09:41:01.874074 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 561/1120] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:41:01 2022] GET /compute/v2.1/servers/ce52be6b-b276-423b-8b23-c76ff0ae73ae => generated 1452 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:41:01.890131 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-3ba33ed6-497d-4241-8c85-66ed9713ca33 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:41:01.890748 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-3ba33ed6-497d-4241-8c85-66ed9713ca33 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] [instance: ce52be6b-b276-423b-8b23-c76ff0ae73ae] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:41:01.898192 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-3ba33ed6-497d-4241-8c85-66ed9713ca33 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:41:01.898646 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-3ba33ed6-497d-4241-8c85-66ed9713ca33 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:41:01.899422 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-3ba33ed6-497d-4241-8c85-66ed9713ca33 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:41:01.899866 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-3ba33ed6-497d-4241-8c85-66ed9713ca33 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:41:02.038247 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-3ba33ed6-497d-4241-8c85-66ed9713ca33 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a446f2a301a04fa485094d7be5219a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c26e375cbb2421b8c8e34653f7d2f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:41:02.046002 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-3ba33ed6-497d-4241-8c85-66ed9713ca33 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] 10.222.0.57 "GET /compute/v2.1/servers/ce52be6b-b276-423b-8b23-c76ff0ae73ae" status: 200 len: 1452 microversion: 2.1 time: 0.160253 Jun 07 09:41:02.046614 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 560/1121] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:41:01 2022] GET /compute/v2.1/servers/ce52be6b-b276-423b-8b23-c76ff0ae73ae => generated 1452 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:41:04.368101 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [req-48d15c06-7263-46c5-aaa3-9ff6cb8b2160 req-4c7e7052-80a3-4455-9b26-a57d8fa24091 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce52be6b-b276-423b-8b23-c76ff0ae73ae", "tag": "4e651f94-a4d4-4193-97e0-1431e700765a"}]} {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:41:04.376787 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [req-48d15c06-7263-46c5-aaa3-9ff6cb8b2160 req-4c7e7052-80a3-4455-9b26-a57d8fa24091 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:41:04.377241 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [req-48d15c06-7263-46c5-aaa3-9ff6cb8b2160 req-4c7e7052-80a3-4455-9b26-a57d8fa24091 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:41:04.388109 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.compute.server_external_events [req-48d15c06-7263-46c5-aaa3-9ff6cb8b2160 req-4c7e7052-80a3-4455-9b26-a57d8fa24091 service nova] Creating event network-changed:4e651f94-a4d4-4193-97e0-1431e700765a for instance ce52be6b-b276-423b-8b23-c76ff0ae73ae on hv-cinder-83699 Jun 07 09:41:04.393246 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [req-48d15c06-7263-46c5-aaa3-9ff6cb8b2160 req-4c7e7052-80a3-4455-9b26-a57d8fa24091 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029388 Jun 07 09:41:04.393789 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 562/1122] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Jun 7 09:41:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 09:41:06.196979 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-e5119c64-e9ab-42de-919a-b196589dabca tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ebcac22a-eac7-41fb-b3bb-eef99bb10c7e", "device": "/dev/sdb"}} {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:41:06.198579 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-e5119c64-e9ab-42de-919a-b196589dabca tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] [instance: 6ffa64c5-ec10-4935-bfbc-b8e191f6564f] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:41:06.205609 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-e5119c64-e9ab-42de-919a-b196589dabca tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:41:06.206061 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-e5119c64-e9ab-42de-919a-b196589dabca tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:41:06.206830 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-e5119c64-e9ab-42de-919a-b196589dabca tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:41:06.207271 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-e5119c64-e9ab-42de-919a-b196589dabca tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:41:06.998628 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-e5119c64-e9ab-42de-919a-b196589dabca tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] 10.222.0.57 "POST /compute/v2.1/servers/6ffa64c5-ec10-4935-bfbc-b8e191f6564f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.806078 Jun 07 09:41:06.999226 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 561/1123] 10.222.0.57 () {60 vars in 1322 bytes} [Tue Jun 7 09:41:06 2022] POST /compute/v2.1/servers/6ffa64c5-ec10-4935-bfbc-b8e191f6564f/os-volume_attachments => generated 194 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:41:34.669463 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3 {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:41:34.674114 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writing DB stats nova_cell1:SELECT=51 {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:41:34.674448 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-ab3ae338-b735-4959-831a-006984f3ef8c tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:41:34.675058 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-ab3ae338-b735-4959-831a-006984f3ef8c tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] [instance: 6ffa64c5-ec10-4935-bfbc-b8e191f6564f] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:41:34.681734 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-ab3ae338-b735-4959-831a-006984f3ef8c tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:41:34.682184 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-ab3ae338-b735-4959-831a-006984f3ef8c tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:41:34.683023 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-ab3ae338-b735-4959-831a-006984f3ef8c tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:41:34.683407 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-ab3ae338-b735-4959-831a-006984f3ef8c tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:41:34.764351 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.objects.instance [None req-ab3ae338-b735-4959-831a-006984f3ef8c tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lazy-loading 'services' on Instance uuid 6ffa64c5-ec10-4935-bfbc-b8e191f6564f {{(pid=118740) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 09:41:34.994146 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-ab3ae338-b735-4959-831a-006984f3ef8c tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] 10.222.0.57 "DELETE /compute/v2.1/servers/6ffa64c5-ec10-4935-bfbc-b8e191f6564f/os-volume_attachments/ebcac22a-eac7-41fb-b3bb-eef99bb10c7e" status: 202 len: 0 microversion: 2.1 time: 0.326206 Jun 07 09:41:34.994751 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 563/1124] 10.222.0.57 () {58 vars in 1415 bytes} [Tue Jun 7 09:41:34 2022] DELETE /compute/v2.1/servers/6ffa64c5-ec10-4935-bfbc-b8e191f6564f/os-volume_attachments/ebcac22a-eac7-41fb-b3bb-eef99bb10c7e => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 09:41:37.164606 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writing DB stats nova_api:SELECT=23 {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:41:37.165508 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:41:37.169691 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-37ccf52f-9551-4d1e-a15d-36d02ff3c5fb tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:41:37.170270 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-37ccf52f-9551-4d1e-a15d-36d02ff3c5fb tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] [instance: 6ffa64c5-ec10-4935-bfbc-b8e191f6564f] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:41:37.176193 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-37ccf52f-9551-4d1e-a15d-36d02ff3c5fb tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:41:37.177959 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-37ccf52f-9551-4d1e-a15d-36d02ff3c5fb tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:41:37.177959 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-37ccf52f-9551-4d1e-a15d-36d02ff3c5fb tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:41:37.177959 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-37ccf52f-9551-4d1e-a15d-36d02ff3c5fb tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:41:37.203746 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-37ccf52f-9551-4d1e-a15d-36d02ff3c5fb tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] [instance: 6ffa64c5-ec10-4935-bfbc-b8e191f6564f] Going to try to terminate instance {{(pid=118741) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 09:41:37.452075 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-37ccf52f-9551-4d1e-a15d-36d02ff3c5fb tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] 10.222.0.57 "DELETE /compute/v2.1/servers/6ffa64c5-ec10-4935-bfbc-b8e191f6564f" status: 204 len: 0 microversion: 2.1 time: 0.288718 Jun 07 09:41:37.452737 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 562/1125] 10.222.0.57 () {58 vars in 1238 bytes} [Tue Jun 7 09:41:37 2022] DELETE /compute/v2.1/servers/6ffa64c5-ec10-4935-bfbc-b8e191f6564f => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 09:41:37.461645 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-e1519d76-bc88-4a83-acbc-80bca1ed4543 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:41:37.462341 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-e1519d76-bc88-4a83-acbc-80bca1ed4543 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] [instance: 6ffa64c5-ec10-4935-bfbc-b8e191f6564f] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:41:37.468560 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-e1519d76-bc88-4a83-acbc-80bca1ed4543 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:41:37.469037 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-e1519d76-bc88-4a83-acbc-80bca1ed4543 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:41:37.469789 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-e1519d76-bc88-4a83-acbc-80bca1ed4543 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:41:37.470223 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-e1519d76-bc88-4a83-acbc-80bca1ed4543 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:41:37.602850 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-e1519d76-bc88-4a83-acbc-80bca1ed4543 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e99a37e30d547b992b4ede147f684a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a185c667b14f19aee6427e4f91af8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:41:37.610274 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-e1519d76-bc88-4a83-acbc-80bca1ed4543 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] 10.222.0.57 "GET /compute/v2.1/servers/6ffa64c5-ec10-4935-bfbc-b8e191f6564f" status: 200 len: 1513 microversion: 2.1 time: 0.153324 Jun 07 09:41:37.610826 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 564/1126] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:41:37 2022] GET /compute/v2.1/servers/6ffa64c5-ec10-4935-bfbc-b8e191f6564f => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:41:38.628377 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-fbe20d1c-98b5-4cd3-9f3e-901e908a019b tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:41:38.629097 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-fbe20d1c-98b5-4cd3-9f3e-901e908a019b tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] [instance: 6ffa64c5-ec10-4935-bfbc-b8e191f6564f] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:41:38.636047 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-fbe20d1c-98b5-4cd3-9f3e-901e908a019b tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:41:38.636490 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-fbe20d1c-98b5-4cd3-9f3e-901e908a019b tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:41:38.637269 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-fbe20d1c-98b5-4cd3-9f3e-901e908a019b tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:41:38.637703 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-fbe20d1c-98b5-4cd3-9f3e-901e908a019b tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:41:38.769455 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-fbe20d1c-98b5-4cd3-9f3e-901e908a019b tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e99a37e30d547b992b4ede147f684a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a185c667b14f19aee6427e4f91af8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:41:38.776888 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-fbe20d1c-98b5-4cd3-9f3e-901e908a019b tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] 10.222.0.57 "GET /compute/v2.1/servers/6ffa64c5-ec10-4935-bfbc-b8e191f6564f" status: 200 len: 1513 microversion: 2.1 time: 0.152686 Jun 07 09:41:38.777449 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 563/1127] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:41:38 2022] GET /compute/v2.1/servers/6ffa64c5-ec10-4935-bfbc-b8e191f6564f => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:41:39.795018 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-359cbee6-76f7-488a-b00d-e0b2ac134a2f tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:41:39.795639 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-359cbee6-76f7-488a-b00d-e0b2ac134a2f tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] [instance: 6ffa64c5-ec10-4935-bfbc-b8e191f6564f] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:41:39.801898 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-359cbee6-76f7-488a-b00d-e0b2ac134a2f tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:41:39.802348 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-359cbee6-76f7-488a-b00d-e0b2ac134a2f tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:41:39.803117 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-359cbee6-76f7-488a-b00d-e0b2ac134a2f tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:41:39.803589 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-359cbee6-76f7-488a-b00d-e0b2ac134a2f tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:41:39.871887 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-359cbee6-76f7-488a-b00d-e0b2ac134a2f tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e99a37e30d547b992b4ede147f684a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a185c667b14f19aee6427e4f91af8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:41:39.879811 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-359cbee6-76f7-488a-b00d-e0b2ac134a2f tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] 10.222.0.57 "GET /compute/v2.1/servers/6ffa64c5-ec10-4935-bfbc-b8e191f6564f" status: 200 len: 1471 microversion: 2.1 time: 0.088671 Jun 07 09:41:39.883875 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 565/1128] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:41:39 2022] GET /compute/v2.1/servers/6ffa64c5-ec10-4935-bfbc-b8e191f6564f => generated 1471 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:41:39.884016 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [req-5f5d7ba8-42a9-46f7-9f80-cb0c291bfab5 req-ea3ce162-e31b-4e01-991a-975ed067fff3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ffa64c5-ec10-4935-bfbc-b8e191f6564f", "name": "network-vif-deleted", "tag": "6fbefa79-2cf7-4b95-a3d6-2760e3aba098"}]} {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:41:39.891677 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [req-5f5d7ba8-42a9-46f7-9f80-cb0c291bfab5 req-ea3ce162-e31b-4e01-991a-975ed067fff3 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:41:39.892111 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [req-5f5d7ba8-42a9-46f7-9f80-cb0c291bfab5 req-ea3ce162-e31b-4e01-991a-975ed067fff3 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:41:39.902814 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.compute.server_external_events [req-5f5d7ba8-42a9-46f7-9f80-cb0c291bfab5 req-ea3ce162-e31b-4e01-991a-975ed067fff3 service nova] Creating event network-vif-deleted:6fbefa79-2cf7-4b95-a3d6-2760e3aba098 for instance 6ffa64c5-ec10-4935-bfbc-b8e191f6564f on hv-cinder-83699 Jun 07 09:41:39.907634 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [req-5f5d7ba8-42a9-46f7-9f80-cb0c291bfab5 req-ea3ce162-e31b-4e01-991a-975ed067fff3 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028894 Jun 07 09:41:39.908205 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 564/1129] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Jun 7 09:41:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:41:40.897587 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-1395e933-64b3-4a00-8cc9-124450ee587e tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:41:40.898113 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-1395e933-64b3-4a00-8cc9-124450ee587e tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] [instance: 6ffa64c5-ec10-4935-bfbc-b8e191f6564f] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:41:40.904664 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-1395e933-64b3-4a00-8cc9-124450ee587e tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:41:40.905115 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-1395e933-64b3-4a00-8cc9-124450ee587e tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:41:40.905877 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-1395e933-64b3-4a00-8cc9-124450ee587e tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:41:40.906314 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-1395e933-64b3-4a00-8cc9-124450ee587e tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:41:40.936110 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-1395e933-64b3-4a00-8cc9-124450ee587e tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:41:40.936555 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-1395e933-64b3-4a00-8cc9-124450ee587e tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:41:40.937025 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.objects.instance [None req-1395e933-64b3-4a00-8cc9-124450ee587e tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lazy-loading 'fault' on Instance uuid 6ffa64c5-ec10-4935-bfbc-b8e191f6564f {{(pid=118740) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 09:41:40.979872 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-1395e933-64b3-4a00-8cc9-124450ee587e tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e99a37e30d547b992b4ede147f684a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a185c667b14f19aee6427e4f91af8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:41:40.987536 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-1395e933-64b3-4a00-8cc9-124450ee587e tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] 10.222.0.57 "GET /compute/v2.1/servers/6ffa64c5-ec10-4935-bfbc-b8e191f6564f" status: 200 len: 1308 microversion: 2.1 time: 0.093868 Jun 07 09:41:40.988136 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 566/1130] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:41:40 2022] GET /compute/v2.1/servers/6ffa64c5-ec10-4935-bfbc-b8e191f6564f => generated 1308 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:41:42.010169 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-e174b5b9-d643-46ef-8daa-5c85c7f94d37 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:41:42.010954 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-e174b5b9-d643-46ef-8daa-5c85c7f94d37 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] [instance: 6ffa64c5-ec10-4935-bfbc-b8e191f6564f] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:41:42.017463 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-e174b5b9-d643-46ef-8daa-5c85c7f94d37 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:41:42.017927 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-e174b5b9-d643-46ef-8daa-5c85c7f94d37 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:41:42.018693 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-e174b5b9-d643-46ef-8daa-5c85c7f94d37 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:41:42.019167 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-e174b5b9-d643-46ef-8daa-5c85c7f94d37 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:41:42.033183 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.wsgi [None req-e174b5b9-d643-46ef-8daa-5c85c7f94d37 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] HTTP exception thrown: Instance 6ffa64c5-ec10-4935-bfbc-b8e191f6564f could not be found. Jun 07 09:41:42.034805 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-e174b5b9-d643-46ef-8daa-5c85c7f94d37 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Request method failure captured: Jun 07 09:41:42.034805 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: request: GET /compute/v2.1/servers/6ffa64c5-ec10-4935-bfbc-b8e191f6564f HTTP/1.1 Jun 07 09:41:42.034805 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Accept: application/json Jun 07 09:41:42.034805 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Accept-Encoding: identity Jun 07 09:41:42.034805 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Connection: close Jun 07 09:41:42.034805 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Content-Length: 0 Jun 07 09:41:42.034805 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Content-Type: application/json Jun 07 09:41:42.034805 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Host: 10.222.0.57 Jun 07 09:41:42.034805 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Openstack-System-Scope: None Jun 07 09:41:42.034805 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: User-Agent: python-urllib3/1.26.9 Jun 07 09:41:42.034805 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Auth-Token: gAAAAABinxz0ddZ7Z14zcEVBLcOhzvBJvAfuujS4Kh-_i_CMQPbsy0UsfiSoSQerbTymLOYaVeSPdzzS1l0iLcxs3fJ7jzL3lNpDqArTejWh1-EYaa5uqm3NlV3DDnchlHRR8szxJgtWy7tLF-Eazc0ufJdGbTbiQNpZTEMwkSrn0JdtT4XXKtY Jun 07 09:41:42.034805 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Domain-Id: None Jun 07 09:41:42.034805 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Domain-Name: None Jun 07 09:41:42.034805 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Identity-Status: Confirmed Jun 07 09:41:42.034805 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Is-Admin-Project: True Jun 07 09:41:42.034805 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Project-Domain-Id: default Jun 07 09:41:42.034805 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Project-Domain-Name: Default Jun 07 09:41:42.034805 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Project-Id: a0a185c667b14f19aee6427e4f91af8d Jun 07 09:41:42.034805 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Project-Name: tempest-VolumesSnapshotTestJSON-153756343 Jun 07 09:41:42.034805 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Role: reader,member Jun 07 09:41:42.034805 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Roles: reader,member Jun 07 09:41:42.036501 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/a0a185c667b14f19aee6427e4f91af8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/a0a185c667b14f19aee6427e4f91af8d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_a0a185c667b14f19aee6427e4f91af8d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/a0a185c667b14f19aee6427e4f91af8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 07 09:41:42.036501 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Tenant: tempest-VolumesSnapshotTestJSON-153756343 Jun 07 09:41:42.036501 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Tenant-Id: a0a185c667b14f19aee6427e4f91af8d Jun 07 09:41:42.036501 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-153756343 Jun 07 09:41:42.036501 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User: tempest-VolumesSnapshotTestJSON-153756343-project Jun 07 09:41:42.036501 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User-Domain-Id: default Jun 07 09:41:42.036501 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User-Domain-Name: Default Jun 07 09:41:42.036501 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User-Id: 2e99a37e30d547b992b4ede147f684a4 Jun 07 09:41:42.036501 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User-Name: tempest-VolumesSnapshotTestJSON-153756343-project Jun 07 09:41:42.036501 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: method: > Jun 07 09:41:42.036501 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: exception: Instance 6ffa64c5-ec10-4935-bfbc-b8e191f6564f could not be found. Jun 07 09:41:42.036501 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: action_args: {'id': '6ffa64c5-ec10-4935-bfbc-b8e191f6564f'} Jun 07 09:41:42.037432 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 09:41:42.037432 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:41:42.037432 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 09:41:42.037432 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 09:41:42.037432 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 09:41:42.037432 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 09:41:42.037432 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 09:41:42.037432 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 09:41:42.037432 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 09:41:42.037432 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 09:41:42.037432 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ffa64c5-ec10-4935-bfbc-b8e191f6564f could not be found. Jun 07 09:41:42.037432 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:41:42.037432 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:41:42.037432 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:41:42.037432 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:41:42.037432 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:41:42.037432 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:41:42.037432 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 09:41:42.037432 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 09:41:42.037432 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 09:41:42.038843 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 09:41:42.038843 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 09:41:42.038843 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 09:41:42.038843 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 09:41:42.038843 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 09:41:42.038843 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 09:41:42.038843 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 09:41:42.038843 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ffa64c5-ec10-4935-bfbc-b8e191f6564f could not be found. Jun 07 09:41:42.038843 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:41:42.038843 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:41:42.038843 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:41:42.038843 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:41:42.038843 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:41:42.038843 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:41:42.038843 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 09:41:42.038843 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 09:41:42.038843 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ffa64c5-ec10-4935-bfbc-b8e191f6564f could not be found. Jun 07 09:41:42.038843 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:41:42.040086 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-e174b5b9-d643-46ef-8daa-5c85c7f94d37 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Returning 404 to user: Instance 6ffa64c5-ec10-4935-bfbc-b8e191f6564f could not be found. {{(pid=118741) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 09:41:42.040086 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-e174b5b9-d643-46ef-8daa-5c85c7f94d37 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] 10.222.0.57 "GET /compute/v2.1/servers/6ffa64c5-ec10-4935-bfbc-b8e191f6564f" status: 404 len: 111 microversion: 2.1 time: 0.031008 Jun 07 09:41:42.040086 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 565/1131] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:41:42 2022] GET /compute/v2.1/servers/6ffa64c5-ec10-4935-bfbc-b8e191f6564f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 09:41:54.605673 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-77912ad2-189c-4472-a6d3-fba4533e337c tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-332067164", "imageRef": "8fdb0275-8c58-4c9e-a2f3-3aae3a947526", "flavorRef": "452", "networks": [{"uuid": "04c29b11-1bb5-4f3c-90d9-666f7df2218f"}]}} {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:41:54.612561 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writing DB stats nova_api:SELECT=10 {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:41:54.613238 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=1 {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:41:54.659091 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.network.neutron [None req-77912ad2-189c-4472-a6d3-fba4533e337c tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] validate_networks() for [('04c29b11-1bb5-4f3c-90d9-666f7df2218f', None, None, None, None, None)] {{(pid=118740) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 09:41:55.000375 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.virt.hardware [None req-77912ad2-189c-4472-a6d3-fba4533e337c tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Flavor limits 0:0:0 {{(pid=118740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 09:41:55.000843 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.virt.hardware [None req-77912ad2-189c-4472-a6d3-fba4533e337c tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Image limits 0:0:0 {{(pid=118740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 09:41:55.001441 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.virt.hardware [None req-77912ad2-189c-4472-a6d3-fba4533e337c tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Flavor pref 0:0:0 {{(pid=118740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 09:41:55.001892 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.virt.hardware [None req-77912ad2-189c-4472-a6d3-fba4533e337c tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Image pref 0:0:0 {{(pid=118740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 09:41:55.002345 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.virt.hardware [None req-77912ad2-189c-4472-a6d3-fba4533e337c tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 09:41:55.011391 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-77912ad2-189c-4472-a6d3-fba4533e337c tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:41:55.011848 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-77912ad2-189c-4472-a6d3-fba4533e337c tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:41:55.012699 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-77912ad2-189c-4472-a6d3-fba4533e337c tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:41:55.013144 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-77912ad2-189c-4472-a6d3-fba4533e337c tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:41:55.030992 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.quota [None req-77912ad2-189c-4472-a6d3-fba4533e337c tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Getting quotas for project a0a185c667b14f19aee6427e4f91af8d. Resources: {'instances', 'cores', 'ram'} {{(pid=118740) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 09:41:55.034919 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.quota [None req-77912ad2-189c-4472-a6d3-fba4533e337c tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Getting quotas for user 2e99a37e30d547b992b4ede147f684a4 and project a0a185c667b14f19aee6427e4f91af8d. Resources: {'instances', 'cores', 'ram'} {{(pid=118740) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 09:41:55.046473 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-77912ad2-189c-4472-a6d3-fba4533e337c tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Going to run 1 instances... {{(pid=118740) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 09:41:55.048764 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-77912ad2-189c-4472-a6d3-fba4533e337c tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] [instance: 591a9359-8011-41a5-b093-63068e1ef306] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8fdb0275-8c58-4c9e-a2f3-3aae3a947526',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118740) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 09:41:55.189422 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-77912ad2-189c-4472-a6d3-fba4533e337c tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.588220 Jun 07 09:41:55.190059 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 567/1132] 10.222.0.57 () {60 vars in 1146 bytes} [Tue Jun 7 09:41:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 590 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 07 09:41:55.200113 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-28acef6d-d8db-43ad-94fb-d73e681c5620 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:41:55.200759 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-28acef6d-d8db-43ad-94fb-d73e681c5620 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] [instance: 591a9359-8011-41a5-b093-63068e1ef306] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:41:55.203626 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:41:55.204342 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:41:55.262501 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-28acef6d-d8db-43ad-94fb-d73e681c5620 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e99a37e30d547b992b4ede147f684a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a185c667b14f19aee6427e4f91af8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:41:55.270436 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-28acef6d-d8db-43ad-94fb-d73e681c5620 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] 10.222.0.57 "GET /compute/v2.1/servers/591a9359-8011-41a5-b093-63068e1ef306" status: 200 len: 1218 microversion: 2.1 time: 0.074210 Jun 07 09:41:55.271005 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 566/1133] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:41:55 2022] GET /compute/v2.1/servers/591a9359-8011-41a5-b093-63068e1ef306 => generated 1218 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:41:56.288089 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-13583f77-f1ce-4aa5-a586-02e212cc9e94 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:41:56.288967 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-13583f77-f1ce-4aa5-a586-02e212cc9e94 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] [instance: 591a9359-8011-41a5-b093-63068e1ef306] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:41:56.296912 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-13583f77-f1ce-4aa5-a586-02e212cc9e94 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:41:56.297364 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-13583f77-f1ce-4aa5-a586-02e212cc9e94 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:41:56.298132 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-13583f77-f1ce-4aa5-a586-02e212cc9e94 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:41:56.298568 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-13583f77-f1ce-4aa5-a586-02e212cc9e94 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:41:56.360899 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-13583f77-f1ce-4aa5-a586-02e212cc9e94 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e99a37e30d547b992b4ede147f684a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a185c667b14f19aee6427e4f91af8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:41:56.368168 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-13583f77-f1ce-4aa5-a586-02e212cc9e94 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] 10.222.0.57 "GET /compute/v2.1/servers/591a9359-8011-41a5-b093-63068e1ef306" status: 200 len: 1222 microversion: 2.1 time: 0.084810 Jun 07 09:41:56.369355 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 568/1134] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:41:56 2022] GET /compute/v2.1/servers/591a9359-8011-41a5-b093-63068e1ef306 => generated 1222 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:41:57.386231 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-b98e7f55-135c-4d68-acf2-6993f876ebd5 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:41:57.387054 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-b98e7f55-135c-4d68-acf2-6993f876ebd5 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] [instance: 591a9359-8011-41a5-b093-63068e1ef306] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:41:57.394429 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b98e7f55-135c-4d68-acf2-6993f876ebd5 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:41:57.394880 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b98e7f55-135c-4d68-acf2-6993f876ebd5 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:41:57.395653 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b98e7f55-135c-4d68-acf2-6993f876ebd5 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:41:57.396092 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b98e7f55-135c-4d68-acf2-6993f876ebd5 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:41:57.470483 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-b98e7f55-135c-4d68-acf2-6993f876ebd5 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e99a37e30d547b992b4ede147f684a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a185c667b14f19aee6427e4f91af8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:41:57.478639 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-b98e7f55-135c-4d68-acf2-6993f876ebd5 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] 10.222.0.57 "GET /compute/v2.1/servers/591a9359-8011-41a5-b093-63068e1ef306" status: 200 len: 1288 microversion: 2.1 time: 0.097005 Jun 07 09:41:57.479202 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 567/1135] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:41:57 2022] GET /compute/v2.1/servers/591a9359-8011-41a5-b093-63068e1ef306 => generated 1288 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:41:58.494941 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-36373817-8286-46ce-92be-799585e42c49 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:41:58.495554 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-36373817-8286-46ce-92be-799585e42c49 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] [instance: 591a9359-8011-41a5-b093-63068e1ef306] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:41:58.501691 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-36373817-8286-46ce-92be-799585e42c49 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:41:58.502156 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-36373817-8286-46ce-92be-799585e42c49 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:41:58.502898 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-36373817-8286-46ce-92be-799585e42c49 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:41:58.503330 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-36373817-8286-46ce-92be-799585e42c49 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:41:58.634537 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-36373817-8286-46ce-92be-799585e42c49 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e99a37e30d547b992b4ede147f684a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a185c667b14f19aee6427e4f91af8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:41:58.642203 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-36373817-8286-46ce-92be-799585e42c49 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] 10.222.0.57 "GET /compute/v2.1/servers/591a9359-8011-41a5-b093-63068e1ef306" status: 200 len: 1318 microversion: 2.1 time: 0.151133 Jun 07 09:41:58.642938 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 569/1136] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:41:58 2022] GET /compute/v2.1/servers/591a9359-8011-41a5-b093-63068e1ef306 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:41:58.788702 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [req-e0bb54b7-4de5-4ced-8dad-58c74923d075 req-bfe66b18-da7b-47a3-a0c4-1d61e29d5dcb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "591a9359-8011-41a5-b093-63068e1ef306", "tag": "e4173757-4739-468f-b72f-cbcf4fd85f2d"}]} {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:41:58.798552 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [req-e0bb54b7-4de5-4ced-8dad-58c74923d075 req-bfe66b18-da7b-47a3-a0c4-1d61e29d5dcb service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:41:58.799126 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [req-e0bb54b7-4de5-4ced-8dad-58c74923d075 req-bfe66b18-da7b-47a3-a0c4-1d61e29d5dcb service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:41:58.812757 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.compute.server_external_events [req-e0bb54b7-4de5-4ced-8dad-58c74923d075 req-bfe66b18-da7b-47a3-a0c4-1d61e29d5dcb service nova] Creating event network-changed:e4173757-4739-468f-b72f-cbcf4fd85f2d for instance 591a9359-8011-41a5-b093-63068e1ef306 on hv-cinder-83699 Jun 07 09:41:58.817616 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [req-e0bb54b7-4de5-4ced-8dad-58c74923d075 req-bfe66b18-da7b-47a3-a0c4-1d61e29d5dcb service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033128 Jun 07 09:41:58.818207 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 568/1137] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Jun 7 09:41:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:41:59.659169 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-45ec66e4-72b4-4d55-8e90-137a83888da2 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:41:59.659789 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-45ec66e4-72b4-4d55-8e90-137a83888da2 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] [instance: 591a9359-8011-41a5-b093-63068e1ef306] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:41:59.666755 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-45ec66e4-72b4-4d55-8e90-137a83888da2 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:41:59.667204 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-45ec66e4-72b4-4d55-8e90-137a83888da2 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:41:59.667970 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-45ec66e4-72b4-4d55-8e90-137a83888da2 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:41:59.668406 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-45ec66e4-72b4-4d55-8e90-137a83888da2 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:41:59.799151 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-45ec66e4-72b4-4d55-8e90-137a83888da2 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e99a37e30d547b992b4ede147f684a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a185c667b14f19aee6427e4f91af8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:41:59.806549 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-45ec66e4-72b4-4d55-8e90-137a83888da2 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] 10.222.0.57 "GET /compute/v2.1/servers/591a9359-8011-41a5-b093-63068e1ef306" status: 200 len: 1318 microversion: 2.1 time: 0.151198 Jun 07 09:41:59.807116 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 570/1138] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:41:59 2022] GET /compute/v2.1/servers/591a9359-8011-41a5-b093-63068e1ef306 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:42:00.824413 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-2a9ac267-3579-4b53-8b5e-654404523309 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:42:00.825142 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-2a9ac267-3579-4b53-8b5e-654404523309 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] [instance: 591a9359-8011-41a5-b093-63068e1ef306] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:42:00.831407 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-2a9ac267-3579-4b53-8b5e-654404523309 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:42:00.831857 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-2a9ac267-3579-4b53-8b5e-654404523309 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:42:00.832638 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-2a9ac267-3579-4b53-8b5e-654404523309 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:42:00.833079 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-2a9ac267-3579-4b53-8b5e-654404523309 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:42:00.959105 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-2a9ac267-3579-4b53-8b5e-654404523309 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e99a37e30d547b992b4ede147f684a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a185c667b14f19aee6427e4f91af8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:42:00.967010 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-2a9ac267-3579-4b53-8b5e-654404523309 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] 10.222.0.57 "GET /compute/v2.1/servers/591a9359-8011-41a5-b093-63068e1ef306" status: 200 len: 1318 microversion: 2.1 time: 0.147686 Jun 07 09:42:00.967571 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 569/1139] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:42:00 2022] GET /compute/v2.1/servers/591a9359-8011-41a5-b093-63068e1ef306 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:42:01.984355 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-c1225762-d35a-4428-af1e-20c3c4d7ad76 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:42:01.984997 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-c1225762-d35a-4428-af1e-20c3c4d7ad76 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] [instance: 591a9359-8011-41a5-b093-63068e1ef306] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:42:01.991592 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-c1225762-d35a-4428-af1e-20c3c4d7ad76 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:42:01.992045 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-c1225762-d35a-4428-af1e-20c3c4d7ad76 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:42:01.992876 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-c1225762-d35a-4428-af1e-20c3c4d7ad76 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:42:01.993927 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-c1225762-d35a-4428-af1e-20c3c4d7ad76 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:42:02.118845 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-c1225762-d35a-4428-af1e-20c3c4d7ad76 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e99a37e30d547b992b4ede147f684a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a185c667b14f19aee6427e4f91af8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:42:02.126310 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-c1225762-d35a-4428-af1e-20c3c4d7ad76 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] 10.222.0.57 "GET /compute/v2.1/servers/591a9359-8011-41a5-b093-63068e1ef306" status: 200 len: 1318 microversion: 2.1 time: 0.145897 Jun 07 09:42:02.126874 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 571/1140] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:42:01 2022] GET /compute/v2.1/servers/591a9359-8011-41a5-b093-63068e1ef306 => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:42:03.143215 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-f25ad46b-ff0f-49cc-90cd-dbae83c9dbf5 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:42:03.143739 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-f25ad46b-ff0f-49cc-90cd-dbae83c9dbf5 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] [instance: 591a9359-8011-41a5-b093-63068e1ef306] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:42:03.150245 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-f25ad46b-ff0f-49cc-90cd-dbae83c9dbf5 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:42:03.150692 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-f25ad46b-ff0f-49cc-90cd-dbae83c9dbf5 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:42:03.151455 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-f25ad46b-ff0f-49cc-90cd-dbae83c9dbf5 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:42:03.151895 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-f25ad46b-ff0f-49cc-90cd-dbae83c9dbf5 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:42:03.278957 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-f25ad46b-ff0f-49cc-90cd-dbae83c9dbf5 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e99a37e30d547b992b4ede147f684a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a185c667b14f19aee6427e4f91af8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:42:03.286343 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-f25ad46b-ff0f-49cc-90cd-dbae83c9dbf5 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] 10.222.0.57 "GET /compute/v2.1/servers/591a9359-8011-41a5-b093-63068e1ef306" status: 200 len: 1318 microversion: 2.1 time: 0.147036 Jun 07 09:42:03.286897 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 570/1141] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:42:03 2022] GET /compute/v2.1/servers/591a9359-8011-41a5-b093-63068e1ef306 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:42:04.303199 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-743060e3-adb8-46b7-a929-b58654aeee09 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:42:04.303811 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-743060e3-adb8-46b7-a929-b58654aeee09 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] [instance: 591a9359-8011-41a5-b093-63068e1ef306] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:42:04.310422 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-743060e3-adb8-46b7-a929-b58654aeee09 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:42:04.310876 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-743060e3-adb8-46b7-a929-b58654aeee09 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:42:04.311671 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-743060e3-adb8-46b7-a929-b58654aeee09 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:42:04.312109 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-743060e3-adb8-46b7-a929-b58654aeee09 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:42:04.417178 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [req-9e7cac37-9eef-4db9-a2ba-f8be1c55209d req-d0f8271f-3d51-4cba-8501-81ff32ac8c04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "591a9359-8011-41a5-b093-63068e1ef306", "name": "network-vif-plugged", "status": "completed", "tag": "e4173757-4739-468f-b72f-cbcf4fd85f2d"}]} {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:42:04.427018 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [req-9e7cac37-9eef-4db9-a2ba-f8be1c55209d req-d0f8271f-3d51-4cba-8501-81ff32ac8c04 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:42:04.427018 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [req-9e7cac37-9eef-4db9-a2ba-f8be1c55209d req-d0f8271f-3d51-4cba-8501-81ff32ac8c04 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:42:04.437291 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.compute.server_external_events [req-9e7cac37-9eef-4db9-a2ba-f8be1c55209d req-d0f8271f-3d51-4cba-8501-81ff32ac8c04 service nova] Creating event network-vif-plugged:e4173757-4739-468f-b72f-cbcf4fd85f2d for instance 591a9359-8011-41a5-b093-63068e1ef306 on hv-cinder-83699 Jun 07 09:42:04.442007 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-743060e3-adb8-46b7-a929-b58654aeee09 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e99a37e30d547b992b4ede147f684a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a185c667b14f19aee6427e4f91af8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:42:04.442322 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [req-9e7cac37-9eef-4db9-a2ba-f8be1c55209d req-d0f8271f-3d51-4cba-8501-81ff32ac8c04 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028725 Jun 07 09:42:04.442931 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 571/1142] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Jun 7 09:42:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 09:42:04.450597 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-743060e3-adb8-46b7-a929-b58654aeee09 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] 10.222.0.57 "GET /compute/v2.1/servers/591a9359-8011-41a5-b093-63068e1ef306" status: 200 len: 1318 microversion: 2.1 time: 0.151438 Jun 07 09:42:04.451149 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 572/1143] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:42:04 2022] GET /compute/v2.1/servers/591a9359-8011-41a5-b093-63068e1ef306 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:42:05.464420 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writing DB stats nova_cell0:SELECT=2 {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:42:05.468994 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-b5a64ae7-887f-48bf-b963-16f9e5c96848 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:42:05.469704 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-b5a64ae7-887f-48bf-b963-16f9e5c96848 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] [instance: 591a9359-8011-41a5-b093-63068e1ef306] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:42:05.475995 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b5a64ae7-887f-48bf-b963-16f9e5c96848 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:42:05.476444 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b5a64ae7-887f-48bf-b963-16f9e5c96848 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:42:05.477235 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b5a64ae7-887f-48bf-b963-16f9e5c96848 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:42:05.477679 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b5a64ae7-887f-48bf-b963-16f9e5c96848 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:42:05.604050 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-b5a64ae7-887f-48bf-b963-16f9e5c96848 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e99a37e30d547b992b4ede147f684a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a185c667b14f19aee6427e4f91af8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:42:05.611519 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-b5a64ae7-887f-48bf-b963-16f9e5c96848 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] 10.222.0.57 "GET /compute/v2.1/servers/591a9359-8011-41a5-b093-63068e1ef306" status: 200 len: 1318 microversion: 2.1 time: 0.148099 Jun 07 09:42:05.612086 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 572/1144] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:42:05 2022] GET /compute/v2.1/servers/591a9359-8011-41a5-b093-63068e1ef306 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:42:06.627479 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-ce1eae64-324f-4521-80ca-3ee6fb3d3fad tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:42:06.628082 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-ce1eae64-324f-4521-80ca-3ee6fb3d3fad tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] [instance: 591a9359-8011-41a5-b093-63068e1ef306] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:42:06.629938 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writing DB stats nova_cell0:SELECT=2 {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:42:06.630600 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writing DB stats nova_cell0:SELECT=6 {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:42:06.635902 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-ce1eae64-324f-4521-80ca-3ee6fb3d3fad tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:42:06.643716 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-ce1eae64-324f-4521-80ca-3ee6fb3d3fad tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:42:06.643716 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-ce1eae64-324f-4521-80ca-3ee6fb3d3fad tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:42:06.643716 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-ce1eae64-324f-4521-80ca-3ee6fb3d3fad tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:42:06.764448 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-ce1eae64-324f-4521-80ca-3ee6fb3d3fad tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e99a37e30d547b992b4ede147f684a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a185c667b14f19aee6427e4f91af8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:42:06.772012 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-ce1eae64-324f-4521-80ca-3ee6fb3d3fad tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] 10.222.0.57 "GET /compute/v2.1/servers/591a9359-8011-41a5-b093-63068e1ef306" status: 200 len: 1318 microversion: 2.1 time: 0.148397 Jun 07 09:42:06.772575 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 573/1145] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:42:06 2022] GET /compute/v2.1/servers/591a9359-8011-41a5-b093-63068e1ef306 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:42:07.788732 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-5f12cdcb-3cfa-4791-8fec-d2ed078c2626 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:42:07.789352 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-5f12cdcb-3cfa-4791-8fec-d2ed078c2626 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] [instance: 591a9359-8011-41a5-b093-63068e1ef306] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:42:07.795909 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-5f12cdcb-3cfa-4791-8fec-d2ed078c2626 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:42:07.796357 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-5f12cdcb-3cfa-4791-8fec-d2ed078c2626 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:42:07.797165 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-5f12cdcb-3cfa-4791-8fec-d2ed078c2626 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:42:07.797604 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-5f12cdcb-3cfa-4791-8fec-d2ed078c2626 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:42:07.926451 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-5f12cdcb-3cfa-4791-8fec-d2ed078c2626 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e99a37e30d547b992b4ede147f684a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a185c667b14f19aee6427e4f91af8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:42:07.934441 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-5f12cdcb-3cfa-4791-8fec-d2ed078c2626 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] 10.222.0.57 "GET /compute/v2.1/servers/591a9359-8011-41a5-b093-63068e1ef306" status: 200 len: 1507 microversion: 2.1 time: 0.149618 Jun 07 09:42:07.935006 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 573/1146] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:42:07 2022] GET /compute/v2.1/servers/591a9359-8011-41a5-b093-63068e1ef306 => generated 1507 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:42:07.951168 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-4972f2fb-b619-41da-bd27-95dcd315edd2 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2dc236b2-74dc-4516-9d09-87b2429f8759", "device": "/dev/sdb"}} {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:42:07.952891 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-4972f2fb-b619-41da-bd27-95dcd315edd2 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] [instance: 591a9359-8011-41a5-b093-63068e1ef306] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:42:07.959438 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-4972f2fb-b619-41da-bd27-95dcd315edd2 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:42:07.959886 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-4972f2fb-b619-41da-bd27-95dcd315edd2 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:42:07.960671 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-4972f2fb-b619-41da-bd27-95dcd315edd2 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:42:07.961112 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-4972f2fb-b619-41da-bd27-95dcd315edd2 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:42:08.741414 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-4972f2fb-b619-41da-bd27-95dcd315edd2 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] 10.222.0.57 "POST /compute/v2.1/servers/591a9359-8011-41a5-b093-63068e1ef306/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.794434 Jun 07 09:42:08.742032 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 574/1147] 10.222.0.57 () {60 vars in 1322 bytes} [Tue Jun 7 09:42:07 2022] POST /compute/v2.1/servers/591a9359-8011-41a5-b093-63068e1ef306/os-volume_attachments => generated 194 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:42:31.578518 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-d71ebdc5-d62a-4acf-997b-5c5713640198 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:42:31.578992 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-d71ebdc5-d62a-4acf-997b-5c5713640198 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] [instance: 591a9359-8011-41a5-b093-63068e1ef306] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:42:31.581188 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writing DB stats nova_api:SELECT=18 {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:42:31.581826 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writing DB stats nova_cell1:SELECT=34 {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:42:31.586480 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-d71ebdc5-d62a-4acf-997b-5c5713640198 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:42:31.586931 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-d71ebdc5-d62a-4acf-997b-5c5713640198 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:42:31.587684 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-d71ebdc5-d62a-4acf-997b-5c5713640198 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:42:31.588118 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-d71ebdc5-d62a-4acf-997b-5c5713640198 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:42:31.665322 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.objects.instance [None req-d71ebdc5-d62a-4acf-997b-5c5713640198 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lazy-loading 'services' on Instance uuid 591a9359-8011-41a5-b093-63068e1ef306 {{(pid=118741) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 09:42:31.890600 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-d71ebdc5-d62a-4acf-997b-5c5713640198 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] 10.222.0.57 "DELETE /compute/v2.1/servers/591a9359-8011-41a5-b093-63068e1ef306/os-volume_attachments/2dc236b2-74dc-4516-9d09-87b2429f8759" status: 202 len: 0 microversion: 2.1 time: 0.315641 Jun 07 09:42:31.891054 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 574/1148] 10.222.0.57 () {58 vars in 1415 bytes} [Tue Jun 7 09:42:31 2022] DELETE /compute/v2.1/servers/591a9359-8011-41a5-b093-63068e1ef306/os-volume_attachments/2dc236b2-74dc-4516-9d09-87b2429f8759 => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 09:42:32.999503 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-b2041653-3327-4926-89b5-ffc4210c78c8 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:42:33.000084 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-b2041653-3327-4926-89b5-ffc4210c78c8 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] [instance: 591a9359-8011-41a5-b093-63068e1ef306] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:42:33.002600 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:42:33.003307 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:42:33.008895 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b2041653-3327-4926-89b5-ffc4210c78c8 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:42:33.008895 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b2041653-3327-4926-89b5-ffc4210c78c8 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:42:33.009475 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b2041653-3327-4926-89b5-ffc4210c78c8 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:42:33.009902 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b2041653-3327-4926-89b5-ffc4210c78c8 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:42:33.036306 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-b2041653-3327-4926-89b5-ffc4210c78c8 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] [instance: 591a9359-8011-41a5-b093-63068e1ef306] Going to try to terminate instance {{(pid=118740) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 09:42:33.318960 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-b2041653-3327-4926-89b5-ffc4210c78c8 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] 10.222.0.57 "DELETE /compute/v2.1/servers/591a9359-8011-41a5-b093-63068e1ef306" status: 204 len: 0 microversion: 2.1 time: 0.323748 Jun 07 09:42:33.319481 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 575/1149] 10.222.0.57 () {58 vars in 1238 bytes} [Tue Jun 7 09:42:32 2022] DELETE /compute/v2.1/servers/591a9359-8011-41a5-b093-63068e1ef306 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 09:42:33.329342 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-e3f9674b-f56d-4d06-9af4-3b276d94698d tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:42:33.330383 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-e3f9674b-f56d-4d06-9af4-3b276d94698d tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] [instance: 591a9359-8011-41a5-b093-63068e1ef306] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:42:33.336375 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-e3f9674b-f56d-4d06-9af4-3b276d94698d tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:42:33.336850 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-e3f9674b-f56d-4d06-9af4-3b276d94698d tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:42:33.337600 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-e3f9674b-f56d-4d06-9af4-3b276d94698d tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:42:33.338030 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-e3f9674b-f56d-4d06-9af4-3b276d94698d tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:42:33.468469 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-e3f9674b-f56d-4d06-9af4-3b276d94698d tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e99a37e30d547b992b4ede147f684a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a185c667b14f19aee6427e4f91af8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:42:33.476135 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-e3f9674b-f56d-4d06-9af4-3b276d94698d tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] 10.222.0.57 "GET /compute/v2.1/servers/591a9359-8011-41a5-b093-63068e1ef306" status: 200 len: 1513 microversion: 2.1 time: 0.152182 Jun 07 09:42:33.476720 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 575/1150] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:42:33 2022] GET /compute/v2.1/servers/591a9359-8011-41a5-b093-63068e1ef306 => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:42:34.494022 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-576a0e4b-25de-4ac4-8388-c7faf0971452 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:42:34.494728 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-576a0e4b-25de-4ac4-8388-c7faf0971452 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] [instance: 591a9359-8011-41a5-b093-63068e1ef306] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:42:34.501146 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-576a0e4b-25de-4ac4-8388-c7faf0971452 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:42:34.501599 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-576a0e4b-25de-4ac4-8388-c7faf0971452 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:42:34.502367 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-576a0e4b-25de-4ac4-8388-c7faf0971452 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:42:34.502804 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-576a0e4b-25de-4ac4-8388-c7faf0971452 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:42:34.634015 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-576a0e4b-25de-4ac4-8388-c7faf0971452 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e99a37e30d547b992b4ede147f684a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a185c667b14f19aee6427e4f91af8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:42:34.642199 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-576a0e4b-25de-4ac4-8388-c7faf0971452 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] 10.222.0.57 "GET /compute/v2.1/servers/591a9359-8011-41a5-b093-63068e1ef306" status: 200 len: 1513 microversion: 2.1 time: 0.152589 Jun 07 09:42:34.642755 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 576/1151] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:42:34 2022] GET /compute/v2.1/servers/591a9359-8011-41a5-b093-63068e1ef306 => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:42:35.659199 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-9863fe3f-9348-4b04-9594-980e0654bb9e tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:42:35.659842 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-9863fe3f-9348-4b04-9594-980e0654bb9e tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] [instance: 591a9359-8011-41a5-b093-63068e1ef306] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:42:35.666233 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-9863fe3f-9348-4b04-9594-980e0654bb9e tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:42:35.666677 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-9863fe3f-9348-4b04-9594-980e0654bb9e tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:42:35.667973 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-9863fe3f-9348-4b04-9594-980e0654bb9e tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:42:35.668407 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-9863fe3f-9348-4b04-9594-980e0654bb9e tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:42:35.876696 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-9863fe3f-9348-4b04-9594-980e0654bb9e tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e99a37e30d547b992b4ede147f684a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a185c667b14f19aee6427e4f91af8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:42:35.885305 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-9863fe3f-9348-4b04-9594-980e0654bb9e tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] 10.222.0.57 "GET /compute/v2.1/servers/591a9359-8011-41a5-b093-63068e1ef306" status: 200 len: 1513 microversion: 2.1 time: 0.229644 Jun 07 09:42:35.886164 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 576/1152] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:42:35 2022] GET /compute/v2.1/servers/591a9359-8011-41a5-b093-63068e1ef306 => generated 1513 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:42:36.117870 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [req-344f3bb7-aa26-424d-b38c-708f1ea80558 req-9e5b42bb-a5fc-43c0-a1ee-84339f9e9e3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "591a9359-8011-41a5-b093-63068e1ef306", "name": "network-vif-deleted", "tag": "e4173757-4739-468f-b72f-cbcf4fd85f2d"}]} {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:42:36.126457 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [req-344f3bb7-aa26-424d-b38c-708f1ea80558 req-9e5b42bb-a5fc-43c0-a1ee-84339f9e9e3b service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:42:36.126905 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [req-344f3bb7-aa26-424d-b38c-708f1ea80558 req-9e5b42bb-a5fc-43c0-a1ee-84339f9e9e3b service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:42:36.138332 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.compute.server_external_events [req-344f3bb7-aa26-424d-b38c-708f1ea80558 req-9e5b42bb-a5fc-43c0-a1ee-84339f9e9e3b service nova] Creating event network-vif-deleted:e4173757-4739-468f-b72f-cbcf4fd85f2d for instance 591a9359-8011-41a5-b093-63068e1ef306 on hv-cinder-83699 Jun 07 09:42:36.143536 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [req-344f3bb7-aa26-424d-b38c-708f1ea80558 req-9e5b42bb-a5fc-43c0-a1ee-84339f9e9e3b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029501 Jun 07 09:42:36.144133 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 577/1153] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Jun 7 09:42:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:42:36.902493 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-2c0af1a6-a4c2-45a7-a2c2-c6e8cb2bc599 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:42:36.903106 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-2c0af1a6-a4c2-45a7-a2c2-c6e8cb2bc599 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] [instance: 591a9359-8011-41a5-b093-63068e1ef306] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:42:36.909459 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-2c0af1a6-a4c2-45a7-a2c2-c6e8cb2bc599 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:42:36.910412 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-2c0af1a6-a4c2-45a7-a2c2-c6e8cb2bc599 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:42:36.910790 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-2c0af1a6-a4c2-45a7-a2c2-c6e8cb2bc599 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:42:36.911233 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-2c0af1a6-a4c2-45a7-a2c2-c6e8cb2bc599 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:42:36.942682 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-2c0af1a6-a4c2-45a7-a2c2-c6e8cb2bc599 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:42:36.943126 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-2c0af1a6-a4c2-45a7-a2c2-c6e8cb2bc599 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:42:36.943556 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.objects.instance [None req-2c0af1a6-a4c2-45a7-a2c2-c6e8cb2bc599 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lazy-loading 'fault' on Instance uuid 591a9359-8011-41a5-b093-63068e1ef306 {{(pid=118741) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 09:42:36.985114 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-2c0af1a6-a4c2-45a7-a2c2-c6e8cb2bc599 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e99a37e30d547b992b4ede147f684a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a185c667b14f19aee6427e4f91af8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:42:36.992636 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-2c0af1a6-a4c2-45a7-a2c2-c6e8cb2bc599 tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] 10.222.0.57 "GET /compute/v2.1/servers/591a9359-8011-41a5-b093-63068e1ef306" status: 200 len: 1308 microversion: 2.1 time: 0.093988 Jun 07 09:42:36.993207 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 577/1154] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:42:36 2022] GET /compute/v2.1/servers/591a9359-8011-41a5-b093-63068e1ef306 => generated 1308 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:42:38.010804 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-32b48577-0526-4420-ab90-5855fe68648c tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:42:38.011499 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-32b48577-0526-4420-ab90-5855fe68648c tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] [instance: 591a9359-8011-41a5-b093-63068e1ef306] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:42:38.018335 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-32b48577-0526-4420-ab90-5855fe68648c tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:42:38.018784 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-32b48577-0526-4420-ab90-5855fe68648c tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:42:38.019548 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-32b48577-0526-4420-ab90-5855fe68648c tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:42:38.020097 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-32b48577-0526-4420-ab90-5855fe68648c tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:42:38.033865 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.wsgi [None req-32b48577-0526-4420-ab90-5855fe68648c tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] HTTP exception thrown: Instance 591a9359-8011-41a5-b093-63068e1ef306 could not be found. Jun 07 09:42:38.035530 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-32b48577-0526-4420-ab90-5855fe68648c tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Request method failure captured: Jun 07 09:42:38.035530 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: request: GET /compute/v2.1/servers/591a9359-8011-41a5-b093-63068e1ef306 HTTP/1.1 Jun 07 09:42:38.035530 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Accept: application/json Jun 07 09:42:38.035530 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Accept-Encoding: identity Jun 07 09:42:38.035530 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Connection: close Jun 07 09:42:38.035530 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Content-Length: 0 Jun 07 09:42:38.035530 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Content-Type: application/json Jun 07 09:42:38.035530 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Host: 10.222.0.57 Jun 07 09:42:38.035530 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Openstack-System-Scope: None Jun 07 09:42:38.035530 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: User-Agent: python-urllib3/1.26.9 Jun 07 09:42:38.035530 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Auth-Token: gAAAAABinxz0ddZ7Z14zcEVBLcOhzvBJvAfuujS4Kh-_i_CMQPbsy0UsfiSoSQerbTymLOYaVeSPdzzS1l0iLcxs3fJ7jzL3lNpDqArTejWh1-EYaa5uqm3NlV3DDnchlHRR8szxJgtWy7tLF-Eazc0ufJdGbTbiQNpZTEMwkSrn0JdtT4XXKtY Jun 07 09:42:38.035530 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Domain-Id: None Jun 07 09:42:38.035530 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Domain-Name: None Jun 07 09:42:38.035530 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Identity-Status: Confirmed Jun 07 09:42:38.035530 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Is-Admin-Project: True Jun 07 09:42:38.035530 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Domain-Id: default Jun 07 09:42:38.035530 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Domain-Name: Default Jun 07 09:42:38.035530 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Id: a0a185c667b14f19aee6427e4f91af8d Jun 07 09:42:38.035530 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Name: tempest-VolumesSnapshotTestJSON-153756343 Jun 07 09:42:38.035530 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Role: reader,member Jun 07 09:42:38.035530 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Roles: reader,member Jun 07 09:42:38.037268 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/a0a185c667b14f19aee6427e4f91af8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/a0a185c667b14f19aee6427e4f91af8d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_a0a185c667b14f19aee6427e4f91af8d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/a0a185c667b14f19aee6427e4f91af8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 07 09:42:38.037268 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Tenant: tempest-VolumesSnapshotTestJSON-153756343 Jun 07 09:42:38.037268 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Tenant-Id: a0a185c667b14f19aee6427e4f91af8d Jun 07 09:42:38.037268 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-153756343 Jun 07 09:42:38.037268 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User: tempest-VolumesSnapshotTestJSON-153756343-project Jun 07 09:42:38.037268 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Domain-Id: default Jun 07 09:42:38.037268 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Domain-Name: Default Jun 07 09:42:38.037268 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Id: 2e99a37e30d547b992b4ede147f684a4 Jun 07 09:42:38.037268 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Name: tempest-VolumesSnapshotTestJSON-153756343-project Jun 07 09:42:38.037268 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: method: > Jun 07 09:42:38.037268 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: exception: Instance 591a9359-8011-41a5-b093-63068e1ef306 could not be found. Jun 07 09:42:38.037268 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: action_args: {'id': '591a9359-8011-41a5-b093-63068e1ef306'} Jun 07 09:42:38.038179 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 09:42:38.038179 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:42:38.038179 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 09:42:38.038179 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 09:42:38.038179 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 09:42:38.038179 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 09:42:38.038179 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 09:42:38.038179 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 09:42:38.038179 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 09:42:38.038179 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 09:42:38.038179 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 591a9359-8011-41a5-b093-63068e1ef306 could not be found. Jun 07 09:42:38.038179 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:42:38.038179 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:42:38.038179 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:42:38.038179 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:42:38.038179 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:42:38.038179 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:42:38.038179 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 09:42:38.038179 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 09:42:38.038179 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 09:42:38.039805 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 09:42:38.039805 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 09:42:38.039805 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 09:42:38.039805 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 09:42:38.039805 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 09:42:38.039805 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 09:42:38.039805 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 09:42:38.039805 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 591a9359-8011-41a5-b093-63068e1ef306 could not be found. Jun 07 09:42:38.039805 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:42:38.039805 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:42:38.039805 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:42:38.039805 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:42:38.039805 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:42:38.039805 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:42:38.039805 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 09:42:38.039805 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 09:42:38.039805 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 591a9359-8011-41a5-b093-63068e1ef306 could not be found. Jun 07 09:42:38.039805 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:42:38.041255 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-32b48577-0526-4420-ab90-5855fe68648c tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] Returning 404 to user: Instance 591a9359-8011-41a5-b093-63068e1ef306 could not be found. {{(pid=118740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 09:42:38.041255 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-32b48577-0526-4420-ab90-5855fe68648c tempest-VolumesSnapshotTestJSON-153756343 tempest-VolumesSnapshotTestJSON-153756343-project] 10.222.0.57 "GET /compute/v2.1/servers/591a9359-8011-41a5-b093-63068e1ef306" status: 404 len: 111 microversion: 2.1 time: 0.030249 Jun 07 09:42:38.041255 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 578/1155] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:42:38 2022] GET /compute/v2.1/servers/591a9359-8011-41a5-b093-63068e1ef306 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 09:43:24.169180 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 09:43:24.170155 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Tue Jun 7 09:43:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 09:43:30.167418 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-1e7fd360-34af-4959-a269-595fb73a4431 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Action: 'create', calling method: .version_select at 0x7f5c978d5430>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1812624265", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCXqm9qXzb0pKj68N3Yi5aOSdXupWIB/RliR3bz603w2ud9H99lXApLoP95n787CnNpGFZ9l7WKhpMMUcSd8X334w2mU6QkCllSGgCdW3zdIxeXjCV6nR33YzVFlBZV0/g=="}} {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:43:30.172477 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writing DB stats nova_api:SELECT=10 {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:43:30.173258 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=1 {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:43:30.184061 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.quota [None req-1e7fd360-34af-4959-a269-595fb73a4431 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Getting quotas for project 17f7583c3efc45cb83a18d3c8f3f1cf6. Resources: {'key_pairs'} {{(pid=118741) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 09:43:30.187995 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.quota [None req-1e7fd360-34af-4959-a269-595fb73a4431 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Getting quotas for user 4658a11ae5b740e78c4ea8e656b46212 and project 17f7583c3efc45cb83a18d3c8f3f1cf6. Resources: {'key_pairs'} {{(pid=118741) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 09:43:30.278396 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-1e7fd360-34af-4959-a269-595fb73a4431 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.114801 Jun 07 09:43:30.278988 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 578/1156] 10.222.0.57 () {60 vars in 1158 bytes} [Tue Jun 7 09:43:30 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:43:30.327276 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-7d78a05c-292f-40ef-bd5c-7031d2356b32 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-327852763", "imageRef": "719b61fb-ec44-4500-b45f-79b3e8db8081", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1812624265", "networks": [{"uuid": "a377942d-ab6f-4343-b8e3-7248cadf1a99"}]}} {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:43:30.334621 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:43:30.335264 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:43:30.506700 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.network.neutron [None req-7d78a05c-292f-40ef-bd5c-7031d2356b32 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] validate_networks() for [('a377942d-ab6f-4343-b8e3-7248cadf1a99', None, None, None, None, None)] {{(pid=118740) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 09:43:31.097705 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.virt.hardware [None req-7d78a05c-292f-40ef-bd5c-7031d2356b32 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Flavor limits 0:0:0 {{(pid=118740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 09:43:31.098085 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.virt.hardware [None req-7d78a05c-292f-40ef-bd5c-7031d2356b32 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Image limits 0:0:0 {{(pid=118740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 09:43:31.098560 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.virt.hardware [None req-7d78a05c-292f-40ef-bd5c-7031d2356b32 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Flavor pref 0:0:0 {{(pid=118740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 09:43:31.098973 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.virt.hardware [None req-7d78a05c-292f-40ef-bd5c-7031d2356b32 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Image pref 0:0:0 {{(pid=118740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 09:43:31.099390 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.virt.hardware [None req-7d78a05c-292f-40ef-bd5c-7031d2356b32 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 09:43:31.109303 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-7d78a05c-292f-40ef-bd5c-7031d2356b32 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:43:31.109749 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-7d78a05c-292f-40ef-bd5c-7031d2356b32 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:43:31.111041 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-7d78a05c-292f-40ef-bd5c-7031d2356b32 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:43:31.111468 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-7d78a05c-292f-40ef-bd5c-7031d2356b32 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:43:31.128216 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.quota [None req-7d78a05c-292f-40ef-bd5c-7031d2356b32 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Getting quotas for project 17f7583c3efc45cb83a18d3c8f3f1cf6. Resources: {'instances', 'cores', 'ram'} {{(pid=118740) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 09:43:31.132101 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.quota [None req-7d78a05c-292f-40ef-bd5c-7031d2356b32 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Getting quotas for user 4658a11ae5b740e78c4ea8e656b46212 and project 17f7583c3efc45cb83a18d3c8f3f1cf6. Resources: {'instances', 'cores', 'ram'} {{(pid=118740) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 09:43:31.142671 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-7d78a05c-292f-40ef-bd5c-7031d2356b32 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Going to run 1 instances... {{(pid=118740) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 09:43:31.144816 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-7d78a05c-292f-40ef-bd5c-7031d2356b32 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] [instance: 06e4dfcb-5449-443b-8fa1-e52fce36cda7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='719b61fb-ec44-4500-b45f-79b3e8db8081',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118740) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 09:43:31.308949 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-7d78a05c-292f-40ef-bd5c-7031d2356b32 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.985667 Jun 07 09:43:31.309585 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 579/1157] 10.222.0.57 () {60 vars in 1146 bytes} [Tue Jun 7 09:43:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 987 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 09:43:31.320910 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-588c44a3-d2f5-4955-a219-8c5b5fa55f7c tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:43:31.321525 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-588c44a3-d2f5-4955-a219-8c5b5fa55f7c tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] [instance: 06e4dfcb-5449-443b-8fa1-e52fce36cda7] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:43:31.481590 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-588c44a3-d2f5-4955-a219-8c5b5fa55f7c tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4658a11ae5b740e78c4ea8e656b46212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f7583c3efc45cb83a18d3c8f3f1cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:43:31.489190 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-588c44a3-d2f5-4955-a219-8c5b5fa55f7c tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] 10.222.0.57 "GET /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7" status: 200 len: 1258 microversion: 2.1 time: 0.173168 Jun 07 09:43:31.489740 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 579/1158] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:43:31 2022] GET /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7 => generated 1258 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:43:32.506855 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-ac76f541-1a27-4a83-8c36-94ac679fdc31 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:43:32.507470 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-ac76f541-1a27-4a83-8c36-94ac679fdc31 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] [instance: 06e4dfcb-5449-443b-8fa1-e52fce36cda7] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:43:32.513655 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-ac76f541-1a27-4a83-8c36-94ac679fdc31 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:43:32.514108 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-ac76f541-1a27-4a83-8c36-94ac679fdc31 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:43:32.514877 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-ac76f541-1a27-4a83-8c36-94ac679fdc31 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:43:32.515317 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-ac76f541-1a27-4a83-8c36-94ac679fdc31 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:43:32.580489 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-ac76f541-1a27-4a83-8c36-94ac679fdc31 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4658a11ae5b740e78c4ea8e656b46212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f7583c3efc45cb83a18d3c8f3f1cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:43:32.587977 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-ac76f541-1a27-4a83-8c36-94ac679fdc31 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] 10.222.0.57 "GET /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7" status: 200 len: 1262 microversion: 2.1 time: 0.085667 Jun 07 09:43:32.588556 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 580/1159] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:43:32 2022] GET /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7 => generated 1262 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:43:33.605986 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-857f41d3-f9e1-4be2-b106-2e16121c4a33 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:43:33.606670 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-857f41d3-f9e1-4be2-b106-2e16121c4a33 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] [instance: 06e4dfcb-5449-443b-8fa1-e52fce36cda7] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:43:33.614150 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-857f41d3-f9e1-4be2-b106-2e16121c4a33 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:43:33.614607 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-857f41d3-f9e1-4be2-b106-2e16121c4a33 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:43:33.615380 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-857f41d3-f9e1-4be2-b106-2e16121c4a33 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:43:33.615821 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-857f41d3-f9e1-4be2-b106-2e16121c4a33 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:43:33.689515 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-857f41d3-f9e1-4be2-b106-2e16121c4a33 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4658a11ae5b740e78c4ea8e656b46212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f7583c3efc45cb83a18d3c8f3f1cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:43:33.697236 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-857f41d3-f9e1-4be2-b106-2e16121c4a33 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] 10.222.0.57 "GET /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7" status: 200 len: 1318 microversion: 2.1 time: 0.095089 Jun 07 09:43:33.697808 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 580/1160] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:43:33 2022] GET /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7 => generated 1318 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:43:34.717795 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-832fa532-1977-4e2e-9e7d-02551732ec70 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:43:34.718725 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-832fa532-1977-4e2e-9e7d-02551732ec70 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] [instance: 06e4dfcb-5449-443b-8fa1-e52fce36cda7] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:43:34.727550 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-832fa532-1977-4e2e-9e7d-02551732ec70 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:43:34.728291 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-832fa532-1977-4e2e-9e7d-02551732ec70 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:43:34.729457 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-832fa532-1977-4e2e-9e7d-02551732ec70 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:43:34.729927 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-832fa532-1977-4e2e-9e7d-02551732ec70 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:43:34.904677 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-832fa532-1977-4e2e-9e7d-02551732ec70 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4658a11ae5b740e78c4ea8e656b46212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f7583c3efc45cb83a18d3c8f3f1cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:43:34.919034 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-832fa532-1977-4e2e-9e7d-02551732ec70 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] 10.222.0.57 "GET /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7" status: 200 len: 1358 microversion: 2.1 time: 0.206066 Jun 07 09:43:34.920190 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 581/1161] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:43:34 2022] GET /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7 => generated 1358 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:43:35.937238 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-5bbcf1e2-1f2d-4b37-8569-0647c0398f81 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:43:35.939090 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-5bbcf1e2-1f2d-4b37-8569-0647c0398f81 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] [instance: 06e4dfcb-5449-443b-8fa1-e52fce36cda7] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:43:35.946104 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-5bbcf1e2-1f2d-4b37-8569-0647c0398f81 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:43:35.961681 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-5bbcf1e2-1f2d-4b37-8569-0647c0398f81 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:43:35.961681 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-5bbcf1e2-1f2d-4b37-8569-0647c0398f81 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:43:35.961681 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-5bbcf1e2-1f2d-4b37-8569-0647c0398f81 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:43:36.087965 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-5bbcf1e2-1f2d-4b37-8569-0647c0398f81 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4658a11ae5b740e78c4ea8e656b46212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f7583c3efc45cb83a18d3c8f3f1cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:43:36.095787 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-5bbcf1e2-1f2d-4b37-8569-0647c0398f81 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] 10.222.0.57 "GET /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7" status: 200 len: 1358 microversion: 2.1 time: 0.162406 Jun 07 09:43:36.096344 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 581/1162] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:43:35 2022] GET /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:43:37.112864 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-9f678d1a-05f4-4ee7-b715-6ffa27ee1b2d tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:43:37.113464 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-9f678d1a-05f4-4ee7-b715-6ffa27ee1b2d tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] [instance: 06e4dfcb-5449-443b-8fa1-e52fce36cda7] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:43:37.119915 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-9f678d1a-05f4-4ee7-b715-6ffa27ee1b2d tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:43:37.120366 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-9f678d1a-05f4-4ee7-b715-6ffa27ee1b2d tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:43:37.121165 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-9f678d1a-05f4-4ee7-b715-6ffa27ee1b2d tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:43:37.121601 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-9f678d1a-05f4-4ee7-b715-6ffa27ee1b2d tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:43:37.250890 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-9f678d1a-05f4-4ee7-b715-6ffa27ee1b2d tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4658a11ae5b740e78c4ea8e656b46212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f7583c3efc45cb83a18d3c8f3f1cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:43:37.258363 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-9f678d1a-05f4-4ee7-b715-6ffa27ee1b2d tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] 10.222.0.57 "GET /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7" status: 200 len: 1358 microversion: 2.1 time: 0.149442 Jun 07 09:43:37.258952 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 582/1163] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:43:37 2022] GET /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:43:38.277397 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-3e01f5e6-c6d1-44c2-b9c8-0d851353dad1 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:43:38.278959 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-3e01f5e6-c6d1-44c2-b9c8-0d851353dad1 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] [instance: 06e4dfcb-5449-443b-8fa1-e52fce36cda7] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:43:38.286462 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-3e01f5e6-c6d1-44c2-b9c8-0d851353dad1 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:43:38.286996 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-3e01f5e6-c6d1-44c2-b9c8-0d851353dad1 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:43:38.287955 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-3e01f5e6-c6d1-44c2-b9c8-0d851353dad1 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:43:38.288398 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-3e01f5e6-c6d1-44c2-b9c8-0d851353dad1 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:43:38.422506 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-3e01f5e6-c6d1-44c2-b9c8-0d851353dad1 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4658a11ae5b740e78c4ea8e656b46212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f7583c3efc45cb83a18d3c8f3f1cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:43:38.430414 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-3e01f5e6-c6d1-44c2-b9c8-0d851353dad1 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] 10.222.0.57 "GET /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7" status: 200 len: 1358 microversion: 2.1 time: 0.157615 Jun 07 09:43:38.432419 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 582/1164] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:43:38 2022] GET /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:43:39.447976 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-8e8bef04-a48e-4b05-a930-05115121d471 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:43:39.449827 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-8e8bef04-a48e-4b05-a930-05115121d471 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] [instance: 06e4dfcb-5449-443b-8fa1-e52fce36cda7] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:43:39.457854 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-8e8bef04-a48e-4b05-a930-05115121d471 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:43:39.458798 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-8e8bef04-a48e-4b05-a930-05115121d471 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:43:39.460485 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-8e8bef04-a48e-4b05-a930-05115121d471 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:43:39.461182 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-8e8bef04-a48e-4b05-a930-05115121d471 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:43:39.598595 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-8e8bef04-a48e-4b05-a930-05115121d471 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4658a11ae5b740e78c4ea8e656b46212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f7583c3efc45cb83a18d3c8f3f1cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:43:39.605882 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-8e8bef04-a48e-4b05-a930-05115121d471 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] 10.222.0.57 "GET /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7" status: 200 len: 1358 microversion: 2.1 time: 0.162449 Jun 07 09:43:39.606443 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 583/1165] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:43:39 2022] GET /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:43:40.623814 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-65403744-0786-46e6-94a4-c8ab5d550e63 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:43:40.624406 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-65403744-0786-46e6-94a4-c8ab5d550e63 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] [instance: 06e4dfcb-5449-443b-8fa1-e52fce36cda7] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:43:40.631906 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-65403744-0786-46e6-94a4-c8ab5d550e63 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:43:40.632358 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-65403744-0786-46e6-94a4-c8ab5d550e63 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:43:40.633160 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-65403744-0786-46e6-94a4-c8ab5d550e63 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:43:40.633598 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-65403744-0786-46e6-94a4-c8ab5d550e63 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:43:40.767774 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-65403744-0786-46e6-94a4-c8ab5d550e63 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4658a11ae5b740e78c4ea8e656b46212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f7583c3efc45cb83a18d3c8f3f1cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:43:40.775553 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-65403744-0786-46e6-94a4-c8ab5d550e63 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] 10.222.0.57 "GET /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7" status: 200 len: 1358 microversion: 2.1 time: 0.155877 Jun 07 09:43:40.778292 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 583/1166] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:43:40 2022] GET /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:43:41.793229 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-10a830d7-57ee-42bb-a7b4-3cf235e02a6f tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:43:41.793917 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-10a830d7-57ee-42bb-a7b4-3cf235e02a6f tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] [instance: 06e4dfcb-5449-443b-8fa1-e52fce36cda7] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:43:41.796158 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writing DB stats nova_cell0:SELECT=2 {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:43:41.797038 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writing DB stats nova_cell0:SELECT=6 {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:43:41.802557 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-10a830d7-57ee-42bb-a7b4-3cf235e02a6f tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:43:41.803009 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-10a830d7-57ee-42bb-a7b4-3cf235e02a6f tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:43:41.803783 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-10a830d7-57ee-42bb-a7b4-3cf235e02a6f tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:43:41.804223 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-10a830d7-57ee-42bb-a7b4-3cf235e02a6f tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:43:41.954945 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-10a830d7-57ee-42bb-a7b4-3cf235e02a6f tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4658a11ae5b740e78c4ea8e656b46212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f7583c3efc45cb83a18d3c8f3f1cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:43:41.963519 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-10a830d7-57ee-42bb-a7b4-3cf235e02a6f tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] 10.222.0.57 "GET /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7" status: 200 len: 1358 microversion: 2.1 time: 0.174043 Jun 07 09:43:41.964482 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 584/1167] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:43:41 2022] GET /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7 => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:43:42.988995 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-fa0a80b6-88c3-4f00-909d-b2266b2c3808 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:43:42.989756 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-fa0a80b6-88c3-4f00-909d-b2266b2c3808 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] [instance: 06e4dfcb-5449-443b-8fa1-e52fce36cda7] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:43:42.991412 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writing DB stats nova_cell0:SELECT=6 {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:43:42.996948 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-fa0a80b6-88c3-4f00-909d-b2266b2c3808 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:43:42.997393 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-fa0a80b6-88c3-4f00-909d-b2266b2c3808 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:43:42.998160 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-fa0a80b6-88c3-4f00-909d-b2266b2c3808 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:43:42.998589 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-fa0a80b6-88c3-4f00-909d-b2266b2c3808 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:43:43.130112 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-fa0a80b6-88c3-4f00-909d-b2266b2c3808 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4658a11ae5b740e78c4ea8e656b46212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f7583c3efc45cb83a18d3c8f3f1cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:43:43.137492 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-fa0a80b6-88c3-4f00-909d-b2266b2c3808 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] 10.222.0.57 "GET /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7" status: 200 len: 1358 microversion: 2.1 time: 0.152409 Jun 07 09:43:43.138037 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 584/1168] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:43:42 2022] GET /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:43:44.154520 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-d6a71690-6d56-41fa-bc30-233317ed792f tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:43:44.155138 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-d6a71690-6d56-41fa-bc30-233317ed792f tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] [instance: 06e4dfcb-5449-443b-8fa1-e52fce36cda7] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:43:44.162197 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-d6a71690-6d56-41fa-bc30-233317ed792f tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:43:44.162641 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-d6a71690-6d56-41fa-bc30-233317ed792f tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:43:44.163430 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-d6a71690-6d56-41fa-bc30-233317ed792f tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:43:44.163863 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-d6a71690-6d56-41fa-bc30-233317ed792f tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:43:44.290401 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-d6a71690-6d56-41fa-bc30-233317ed792f tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4658a11ae5b740e78c4ea8e656b46212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f7583c3efc45cb83a18d3c8f3f1cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:43:44.297855 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-d6a71690-6d56-41fa-bc30-233317ed792f tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] 10.222.0.57 "GET /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7" status: 200 len: 1358 microversion: 2.1 time: 0.147547 Jun 07 09:43:44.298427 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 585/1169] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:43:44 2022] GET /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7 => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:43:45.314749 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-11665b50-eec2-4329-b0b5-ff48cb39f937 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:43:45.315301 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-11665b50-eec2-4329-b0b5-ff48cb39f937 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] [instance: 06e4dfcb-5449-443b-8fa1-e52fce36cda7] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:43:45.321780 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-11665b50-eec2-4329-b0b5-ff48cb39f937 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:43:45.322230 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-11665b50-eec2-4329-b0b5-ff48cb39f937 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:43:45.323100 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-11665b50-eec2-4329-b0b5-ff48cb39f937 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:43:45.323539 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-11665b50-eec2-4329-b0b5-ff48cb39f937 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:43:45.446719 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-11665b50-eec2-4329-b0b5-ff48cb39f937 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4658a11ae5b740e78c4ea8e656b46212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f7583c3efc45cb83a18d3c8f3f1cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:43:45.454095 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-11665b50-eec2-4329-b0b5-ff48cb39f937 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] 10.222.0.57 "GET /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7" status: 200 len: 1358 microversion: 2.1 time: 0.143302 Jun 07 09:43:45.454656 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 585/1170] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:43:45 2022] GET /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7 => generated 1358 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:43:46.301453 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [req-e8f0565f-0370-44e2-86cd-3501dcf23ce0 req-3a93a260-7bcb-464b-b753-8b69eaea741c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06e4dfcb-5449-443b-8fa1-e52fce36cda7", "tag": "7d0625d7-0de3-40be-af38-c06ed2b15941"}]} {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:43:46.310133 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [req-e8f0565f-0370-44e2-86cd-3501dcf23ce0 req-3a93a260-7bcb-464b-b753-8b69eaea741c service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:43:46.316189 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [req-e8f0565f-0370-44e2-86cd-3501dcf23ce0 req-3a93a260-7bcb-464b-b753-8b69eaea741c service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:43:46.323239 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.compute.server_external_events [req-e8f0565f-0370-44e2-86cd-3501dcf23ce0 req-3a93a260-7bcb-464b-b753-8b69eaea741c service nova] Creating event network-changed:7d0625d7-0de3-40be-af38-c06ed2b15941 for instance 06e4dfcb-5449-443b-8fa1-e52fce36cda7 on hv-cinder-83699 Jun 07 09:43:46.328418 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [req-e8f0565f-0370-44e2-86cd-3501dcf23ce0 req-3a93a260-7bcb-464b-b753-8b69eaea741c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030595 Jun 07 09:43:46.329057 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 586/1171] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Jun 7 09:43:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:43:46.471510 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-bba71eba-961c-4e16-8e90-47995570bc41 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:43:46.472116 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-bba71eba-961c-4e16-8e90-47995570bc41 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] [instance: 06e4dfcb-5449-443b-8fa1-e52fce36cda7] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:43:46.478679 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-bba71eba-961c-4e16-8e90-47995570bc41 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:43:46.479119 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-bba71eba-961c-4e16-8e90-47995570bc41 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:43:46.479872 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-bba71eba-961c-4e16-8e90-47995570bc41 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:43:46.480303 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-bba71eba-961c-4e16-8e90-47995570bc41 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:43:46.639736 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-bba71eba-961c-4e16-8e90-47995570bc41 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4658a11ae5b740e78c4ea8e656b46212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f7583c3efc45cb83a18d3c8f3f1cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:43:46.647776 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-bba71eba-961c-4e16-8e90-47995570bc41 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] 10.222.0.57 "GET /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7" status: 200 len: 1358 microversion: 2.1 time: 0.180444 Jun 07 09:43:46.648342 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 586/1172] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:43:46 2022] GET /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7 => generated 1358 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:43:47.586559 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-2c9148b6-baf5-43a6-9147-3d98bea25092 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:43:47.587102 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-2c9148b6-baf5-43a6-9147-3d98bea25092 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] [instance: ce52be6b-b276-423b-8b23-c76ff0ae73ae] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:43:47.593309 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-2c9148b6-baf5-43a6-9147-3d98bea25092 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:43:47.593755 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-2c9148b6-baf5-43a6-9147-3d98bea25092 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:43:47.594792 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-2c9148b6-baf5-43a6-9147-3d98bea25092 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:43:47.595226 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-2c9148b6-baf5-43a6-9147-3d98bea25092 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:43:47.619807 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-2c9148b6-baf5-43a6-9147-3d98bea25092 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] [instance: ce52be6b-b276-423b-8b23-c76ff0ae73ae] Going to try to terminate instance {{(pid=118740) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 09:43:47.665088 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-3dbf099b-783d-4caf-9465-af9dfc3d9bb2 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:43:47.665723 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-3dbf099b-783d-4caf-9465-af9dfc3d9bb2 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] [instance: 06e4dfcb-5449-443b-8fa1-e52fce36cda7] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:43:47.672060 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-3dbf099b-783d-4caf-9465-af9dfc3d9bb2 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:43:47.672507 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-3dbf099b-783d-4caf-9465-af9dfc3d9bb2 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:43:47.673304 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-3dbf099b-783d-4caf-9465-af9dfc3d9bb2 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:43:47.673731 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-3dbf099b-783d-4caf-9465-af9dfc3d9bb2 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:43:47.804338 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-3dbf099b-783d-4caf-9465-af9dfc3d9bb2 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4658a11ae5b740e78c4ea8e656b46212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f7583c3efc45cb83a18d3c8f3f1cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:43:47.811708 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-3dbf099b-783d-4caf-9465-af9dfc3d9bb2 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] 10.222.0.57 "GET /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7" status: 200 len: 1358 microversion: 2.1 time: 0.150508 Jun 07 09:43:47.812256 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 587/1173] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:43:47 2022] GET /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:43:48.003164 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-2c9148b6-baf5-43a6-9147-3d98bea25092 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] 10.222.0.57 "DELETE /compute/v2.1/servers/ce52be6b-b276-423b-8b23-c76ff0ae73ae" status: 204 len: 0 microversion: 2.1 time: 0.421138 Jun 07 09:43:48.003948 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 587/1174] 10.222.0.57 () {58 vars in 1238 bytes} [Tue Jun 7 09:43:47 2022] DELETE /compute/v2.1/servers/ce52be6b-b276-423b-8b23-c76ff0ae73ae => generated 0 bytes in 423 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 09:43:48.011851 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-6e591b10-3e27-4105-a48c-c9477626f2ac tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:43:48.012460 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-6e591b10-3e27-4105-a48c-c9477626f2ac tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] [instance: ce52be6b-b276-423b-8b23-c76ff0ae73ae] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:43:48.019136 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-6e591b10-3e27-4105-a48c-c9477626f2ac tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:43:48.019577 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-6e591b10-3e27-4105-a48c-c9477626f2ac tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:43:48.020336 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-6e591b10-3e27-4105-a48c-c9477626f2ac tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:43:48.020803 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-6e591b10-3e27-4105-a48c-c9477626f2ac tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:43:48.148307 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-6e591b10-3e27-4105-a48c-c9477626f2ac tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a446f2a301a04fa485094d7be5219a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c26e375cbb2421b8c8e34653f7d2f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:43:48.155934 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-6e591b10-3e27-4105-a48c-c9477626f2ac tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] 10.222.0.57 "GET /compute/v2.1/servers/ce52be6b-b276-423b-8b23-c76ff0ae73ae" status: 200 len: 1575 microversion: 2.1 time: 0.147922 Jun 07 09:43:48.156497 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 588/1175] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:43:48 2022] GET /compute/v2.1/servers/ce52be6b-b276-423b-8b23-c76ff0ae73ae => generated 1575 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:43:48.828776 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-a7ef1cb7-08f4-491c-8f68-9d06b68ba1c6 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:43:48.829475 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-a7ef1cb7-08f4-491c-8f68-9d06b68ba1c6 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] [instance: 06e4dfcb-5449-443b-8fa1-e52fce36cda7] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:43:48.835855 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-a7ef1cb7-08f4-491c-8f68-9d06b68ba1c6 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:43:48.836305 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-a7ef1cb7-08f4-491c-8f68-9d06b68ba1c6 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:43:48.837105 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-a7ef1cb7-08f4-491c-8f68-9d06b68ba1c6 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:43:48.837540 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-a7ef1cb7-08f4-491c-8f68-9d06b68ba1c6 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:43:48.963259 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-a7ef1cb7-08f4-491c-8f68-9d06b68ba1c6 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4658a11ae5b740e78c4ea8e656b46212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f7583c3efc45cb83a18d3c8f3f1cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:43:48.971463 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-a7ef1cb7-08f4-491c-8f68-9d06b68ba1c6 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] 10.222.0.57 "GET /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7" status: 200 len: 1358 microversion: 2.1 time: 0.146926 Jun 07 09:43:48.972074 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 588/1176] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:43:48 2022] GET /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7 => generated 1358 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:43:49.173553 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-109d8411-249f-4a63-82fc-8f3bd4a1f896 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:43:49.174208 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-109d8411-249f-4a63-82fc-8f3bd4a1f896 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] [instance: ce52be6b-b276-423b-8b23-c76ff0ae73ae] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:43:49.180809 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-109d8411-249f-4a63-82fc-8f3bd4a1f896 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:43:49.181264 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-109d8411-249f-4a63-82fc-8f3bd4a1f896 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:43:49.182018 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-109d8411-249f-4a63-82fc-8f3bd4a1f896 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:43:49.182454 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-109d8411-249f-4a63-82fc-8f3bd4a1f896 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:43:49.314951 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-109d8411-249f-4a63-82fc-8f3bd4a1f896 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a446f2a301a04fa485094d7be5219a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c26e375cbb2421b8c8e34653f7d2f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:43:49.322371 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-109d8411-249f-4a63-82fc-8f3bd4a1f896 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] 10.222.0.57 "GET /compute/v2.1/servers/ce52be6b-b276-423b-8b23-c76ff0ae73ae" status: 200 len: 1575 microversion: 2.1 time: 0.152801 Jun 07 09:43:49.322926 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 589/1177] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:43:49 2022] GET /compute/v2.1/servers/ce52be6b-b276-423b-8b23-c76ff0ae73ae => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:43:49.988242 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-56f976f6-454f-4baa-8610-24e934837c9c tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:43:49.988970 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-56f976f6-454f-4baa-8610-24e934837c9c tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] [instance: 06e4dfcb-5449-443b-8fa1-e52fce36cda7] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:43:49.995439 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-56f976f6-454f-4baa-8610-24e934837c9c tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:43:49.995928 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-56f976f6-454f-4baa-8610-24e934837c9c tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:43:49.996726 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-56f976f6-454f-4baa-8610-24e934837c9c tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:43:49.997171 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-56f976f6-454f-4baa-8610-24e934837c9c tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:43:50.121997 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-56f976f6-454f-4baa-8610-24e934837c9c tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4658a11ae5b740e78c4ea8e656b46212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f7583c3efc45cb83a18d3c8f3f1cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:43:50.129848 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-56f976f6-454f-4baa-8610-24e934837c9c tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] 10.222.0.57 "GET /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7" status: 200 len: 1358 microversion: 2.1 time: 0.145557 Jun 07 09:43:50.130414 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 589/1178] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:43:49 2022] GET /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7 => generated 1358 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:43:50.339832 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-b9ef4386-d4e2-420c-b04b-541fa1085419 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:43:50.340349 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-b9ef4386-d4e2-420c-b04b-541fa1085419 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] [instance: ce52be6b-b276-423b-8b23-c76ff0ae73ae] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:43:50.347025 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b9ef4386-d4e2-420c-b04b-541fa1085419 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:43:50.347448 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b9ef4386-d4e2-420c-b04b-541fa1085419 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:43:50.348191 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b9ef4386-d4e2-420c-b04b-541fa1085419 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:43:50.348740 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b9ef4386-d4e2-420c-b04b-541fa1085419 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:43:50.476099 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-b9ef4386-d4e2-420c-b04b-541fa1085419 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a446f2a301a04fa485094d7be5219a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c26e375cbb2421b8c8e34653f7d2f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:43:50.483531 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-b9ef4386-d4e2-420c-b04b-541fa1085419 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] 10.222.0.57 "GET /compute/v2.1/servers/ce52be6b-b276-423b-8b23-c76ff0ae73ae" status: 200 len: 1575 microversion: 2.1 time: 0.147587 Jun 07 09:43:50.484095 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 590/1179] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:43:50 2022] GET /compute/v2.1/servers/ce52be6b-b276-423b-8b23-c76ff0ae73ae => generated 1575 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:43:51.145888 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-6c1e85a1-6bb1-4e6a-aeb9-4c16f37c0ad3 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:43:51.146508 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-6c1e85a1-6bb1-4e6a-aeb9-4c16f37c0ad3 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] [instance: 06e4dfcb-5449-443b-8fa1-e52fce36cda7] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:43:51.153135 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-6c1e85a1-6bb1-4e6a-aeb9-4c16f37c0ad3 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:43:51.153599 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-6c1e85a1-6bb1-4e6a-aeb9-4c16f37c0ad3 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:43:51.154368 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-6c1e85a1-6bb1-4e6a-aeb9-4c16f37c0ad3 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:43:51.154808 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-6c1e85a1-6bb1-4e6a-aeb9-4c16f37c0ad3 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:43:51.287801 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-6c1e85a1-6bb1-4e6a-aeb9-4c16f37c0ad3 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4658a11ae5b740e78c4ea8e656b46212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f7583c3efc45cb83a18d3c8f3f1cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:43:51.295180 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-6c1e85a1-6bb1-4e6a-aeb9-4c16f37c0ad3 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] 10.222.0.57 "GET /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7" status: 200 len: 1358 microversion: 2.1 time: 0.153191 Jun 07 09:43:51.295743 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 590/1180] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:43:51 2022] GET /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:43:51.501259 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-10d1f341-0dbd-4959-83f3-380366e7aa1b tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:43:51.501882 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-10d1f341-0dbd-4959-83f3-380366e7aa1b tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] [instance: ce52be6b-b276-423b-8b23-c76ff0ae73ae] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:43:51.508826 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-10d1f341-0dbd-4959-83f3-380366e7aa1b tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:43:51.516566 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-10d1f341-0dbd-4959-83f3-380366e7aa1b tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:43:51.516566 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-10d1f341-0dbd-4959-83f3-380366e7aa1b tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:43:51.516566 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-10d1f341-0dbd-4959-83f3-380366e7aa1b tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:43:51.754544 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-10d1f341-0dbd-4959-83f3-380366e7aa1b tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a446f2a301a04fa485094d7be5219a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c26e375cbb2421b8c8e34653f7d2f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:43:51.762203 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-10d1f341-0dbd-4959-83f3-380366e7aa1b tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] 10.222.0.57 "GET /compute/v2.1/servers/ce52be6b-b276-423b-8b23-c76ff0ae73ae" status: 200 len: 1575 microversion: 2.1 time: 0.264866 Jun 07 09:43:51.762774 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 591/1181] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:43:51 2022] GET /compute/v2.1/servers/ce52be6b-b276-423b-8b23-c76ff0ae73ae => generated 1575 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:43:52.243551 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [req-12a1b139-80e5-4b6c-a51c-e5c019c4cff7 req-2df81633-86ff-49e2-b69c-863fdf211dfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce52be6b-b276-423b-8b23-c76ff0ae73ae", "name": "network-vif-deleted", "tag": "4e651f94-a4d4-4193-97e0-1431e700765a"}]} {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:43:52.252213 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [req-12a1b139-80e5-4b6c-a51c-e5c019c4cff7 req-2df81633-86ff-49e2-b69c-863fdf211dfa service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:43:52.252764 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [req-12a1b139-80e5-4b6c-a51c-e5c019c4cff7 req-2df81633-86ff-49e2-b69c-863fdf211dfa service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:43:52.263906 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.compute.server_external_events [req-12a1b139-80e5-4b6c-a51c-e5c019c4cff7 req-2df81633-86ff-49e2-b69c-863fdf211dfa service nova] Creating event network-vif-deleted:4e651f94-a4d4-4193-97e0-1431e700765a for instance ce52be6b-b276-423b-8b23-c76ff0ae73ae on hv-cinder-83699 Jun 07 09:43:52.269214 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [req-12a1b139-80e5-4b6c-a51c-e5c019c4cff7 req-2df81633-86ff-49e2-b69c-863fdf211dfa service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029672 Jun 07 09:43:52.270263 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 591/1182] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Jun 7 09:43:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:43:52.311256 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-242792fc-f905-4c52-b0bc-672cb02b4a9d tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:43:52.311874 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-242792fc-f905-4c52-b0bc-672cb02b4a9d tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] [instance: 06e4dfcb-5449-443b-8fa1-e52fce36cda7] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:43:52.320473 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-242792fc-f905-4c52-b0bc-672cb02b4a9d tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:43:52.321043 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-242792fc-f905-4c52-b0bc-672cb02b4a9d tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:43:52.321760 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-242792fc-f905-4c52-b0bc-672cb02b4a9d tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:43:52.322200 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-242792fc-f905-4c52-b0bc-672cb02b4a9d tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:43:52.462680 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-242792fc-f905-4c52-b0bc-672cb02b4a9d tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4658a11ae5b740e78c4ea8e656b46212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f7583c3efc45cb83a18d3c8f3f1cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:43:52.471955 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-242792fc-f905-4c52-b0bc-672cb02b4a9d tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] 10.222.0.57 "GET /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7" status: 200 len: 1358 microversion: 2.1 time: 0.164443 Jun 07 09:43:52.476009 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 592/1183] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:43:52 2022] GET /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:43:52.781033 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-1326f4f4-fa75-4a17-8e6b-57b2213d2388 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:43:52.781803 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-1326f4f4-fa75-4a17-8e6b-57b2213d2388 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] [instance: ce52be6b-b276-423b-8b23-c76ff0ae73ae] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:43:52.788657 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-1326f4f4-fa75-4a17-8e6b-57b2213d2388 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:43:52.789176 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-1326f4f4-fa75-4a17-8e6b-57b2213d2388 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:43:52.790120 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-1326f4f4-fa75-4a17-8e6b-57b2213d2388 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:43:52.791119 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-1326f4f4-fa75-4a17-8e6b-57b2213d2388 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:43:52.856887 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-1326f4f4-fa75-4a17-8e6b-57b2213d2388 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a446f2a301a04fa485094d7be5219a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c26e375cbb2421b8c8e34653f7d2f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:43:52.864631 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-1326f4f4-fa75-4a17-8e6b-57b2213d2388 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] 10.222.0.57 "GET /compute/v2.1/servers/ce52be6b-b276-423b-8b23-c76ff0ae73ae" status: 200 len: 1224 microversion: 2.1 time: 0.089037 Jun 07 09:43:52.872768 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 592/1184] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:43:52 2022] GET /compute/v2.1/servers/ce52be6b-b276-423b-8b23-c76ff0ae73ae => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:43:53.145870 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [req-e89b2455-ee8c-4690-8160-731d0817e725 req-688bb628-b1de-43c3-9b08-50efc31a915b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06e4dfcb-5449-443b-8fa1-e52fce36cda7", "name": "network-vif-plugged", "status": "completed", "tag": "7d0625d7-0de3-40be-af38-c06ed2b15941"}]} {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:43:53.154733 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [req-e89b2455-ee8c-4690-8160-731d0817e725 req-688bb628-b1de-43c3-9b08-50efc31a915b service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:43:53.155178 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [req-e89b2455-ee8c-4690-8160-731d0817e725 req-688bb628-b1de-43c3-9b08-50efc31a915b service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:43:53.167192 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.compute.server_external_events [req-e89b2455-ee8c-4690-8160-731d0817e725 req-688bb628-b1de-43c3-9b08-50efc31a915b service nova] Creating event network-vif-plugged:7d0625d7-0de3-40be-af38-c06ed2b15941 for instance 06e4dfcb-5449-443b-8fa1-e52fce36cda7 on hv-cinder-83699 Jun 07 09:43:53.172091 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [req-e89b2455-ee8c-4690-8160-731d0817e725 req-688bb628-b1de-43c3-9b08-50efc31a915b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030630 Jun 07 09:43:53.172712 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 593/1185] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Jun 7 09:43:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:43:53.491116 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-0df72345-a01a-49ba-99a4-39b1c12b5a2a tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:43:53.491881 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-0df72345-a01a-49ba-99a4-39b1c12b5a2a tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] [instance: 06e4dfcb-5449-443b-8fa1-e52fce36cda7] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:43:53.499657 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-0df72345-a01a-49ba-99a4-39b1c12b5a2a tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:43:53.503537 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-0df72345-a01a-49ba-99a4-39b1c12b5a2a tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:43:53.503537 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-0df72345-a01a-49ba-99a4-39b1c12b5a2a tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:43:53.503537 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-0df72345-a01a-49ba-99a4-39b1c12b5a2a tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:43:53.639461 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-0df72345-a01a-49ba-99a4-39b1c12b5a2a tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4658a11ae5b740e78c4ea8e656b46212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f7583c3efc45cb83a18d3c8f3f1cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:43:53.647204 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-0df72345-a01a-49ba-99a4-39b1c12b5a2a tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] 10.222.0.57 "GET /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7" status: 200 len: 1358 microversion: 2.1 time: 0.161283 Jun 07 09:43:53.647765 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 593/1186] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:43:53 2022] GET /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:43:53.882495 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-3d7171f6-3080-4e33-a688-b87f5aa9fadd tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:43:53.883193 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-3d7171f6-3080-4e33-a688-b87f5aa9fadd tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] [instance: ce52be6b-b276-423b-8b23-c76ff0ae73ae] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:43:53.889415 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-3d7171f6-3080-4e33-a688-b87f5aa9fadd tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:43:53.889867 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-3d7171f6-3080-4e33-a688-b87f5aa9fadd tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:43:53.890620 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-3d7171f6-3080-4e33-a688-b87f5aa9fadd tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:43:53.891053 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-3d7171f6-3080-4e33-a688-b87f5aa9fadd tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:43:53.903923 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.wsgi [None req-3d7171f6-3080-4e33-a688-b87f5aa9fadd tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] HTTP exception thrown: Instance ce52be6b-b276-423b-8b23-c76ff0ae73ae could not be found. Jun 07 09:43:53.905559 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-3d7171f6-3080-4e33-a688-b87f5aa9fadd tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Request method failure captured: Jun 07 09:43:53.905559 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: request: GET /compute/v2.1/servers/ce52be6b-b276-423b-8b23-c76ff0ae73ae HTTP/1.1 Jun 07 09:43:53.905559 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Accept: application/json Jun 07 09:43:53.905559 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Accept-Encoding: identity Jun 07 09:43:53.905559 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Connection: close Jun 07 09:43:53.905559 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Content-Length: 0 Jun 07 09:43:53.905559 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Content-Type: application/json Jun 07 09:43:53.905559 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Host: 10.222.0.57 Jun 07 09:43:53.905559 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Openstack-System-Scope: None Jun 07 09:43:53.905559 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: User-Agent: python-urllib3/1.26.9 Jun 07 09:43:53.905559 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Auth-Token: gAAAAABinxzsDk7Tr2bhRcq_y4ijfKtEcxnIMVX4Vn0603GqFK0hTVKCqC3rd3N0YTH6PRRBDYeQRkqV5LoZcWzSAVfgOptpKFIYOUmAh5Y-ZZ8mf_rvxcMR2OzrItNFLjn6yGdH6j6rWHYcdFR4RXgzwq9giyQwZ8_Cnx_We1jh4IdHzaUqWDA Jun 07 09:43:53.905559 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Domain-Id: None Jun 07 09:43:53.905559 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Domain-Name: None Jun 07 09:43:53.905559 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Identity-Status: Confirmed Jun 07 09:43:53.905559 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Is-Admin-Project: True Jun 07 09:43:53.905559 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Project-Domain-Id: default Jun 07 09:43:53.905559 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Project-Domain-Name: Default Jun 07 09:43:53.905559 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Project-Id: 8c26e375cbb2421b8c8e34653f7d2f38 Jun 07 09:43:53.905559 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Project-Name: tempest-TestVolumeBootPattern-1188106385 Jun 07 09:43:53.905559 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Role: reader,member Jun 07 09:43:53.905559 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Roles: reader,member Jun 07 09:43:53.907332 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8c26e375cbb2421b8c8e34653f7d2f38"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/8c26e375cbb2421b8c8e34653f7d2f38"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_8c26e375cbb2421b8c8e34653f7d2f38"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8c26e375cbb2421b8c8e34653f7d2f38"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 07 09:43:53.907332 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Tenant: tempest-TestVolumeBootPattern-1188106385 Jun 07 09:43:53.907332 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Tenant-Id: 8c26e375cbb2421b8c8e34653f7d2f38 Jun 07 09:43:53.907332 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Tenant-Name: tempest-TestVolumeBootPattern-1188106385 Jun 07 09:43:53.907332 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User: tempest-TestVolumeBootPattern-1188106385-project Jun 07 09:43:53.907332 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User-Domain-Id: default Jun 07 09:43:53.907332 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User-Domain-Name: Default Jun 07 09:43:53.907332 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User-Id: a446f2a301a04fa485094d7be5219a07 Jun 07 09:43:53.907332 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User-Name: tempest-TestVolumeBootPattern-1188106385-project Jun 07 09:43:53.907332 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: method: > Jun 07 09:43:53.907332 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: exception: Instance ce52be6b-b276-423b-8b23-c76ff0ae73ae could not be found. Jun 07 09:43:53.907332 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: action_args: {'id': 'ce52be6b-b276-423b-8b23-c76ff0ae73ae'} Jun 07 09:43:53.908890 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 09:43:53.908890 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:43:53.908890 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 09:43:53.908890 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 09:43:53.908890 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 09:43:53.908890 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 09:43:53.908890 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 09:43:53.908890 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 09:43:53.908890 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 09:43:53.908890 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 09:43:53.908890 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce52be6b-b276-423b-8b23-c76ff0ae73ae could not be found. Jun 07 09:43:53.908890 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:43:53.908890 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:43:53.908890 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:43:53.908890 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:43:53.908890 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:43:53.908890 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:43:53.908890 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 09:43:53.908890 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 09:43:53.908890 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 09:43:53.910494 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 09:43:53.910494 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 09:43:53.910494 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 09:43:53.910494 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 09:43:53.910494 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 09:43:53.910494 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 09:43:53.910494 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 09:43:53.910494 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce52be6b-b276-423b-8b23-c76ff0ae73ae could not be found. Jun 07 09:43:53.910494 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:43:53.910494 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:43:53.910494 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:43:53.910494 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:43:53.910494 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:43:53.910494 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:43:53.910494 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 09:43:53.910494 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 09:43:53.910494 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce52be6b-b276-423b-8b23-c76ff0ae73ae could not be found. Jun 07 09:43:53.910494 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:43:53.911940 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-3d7171f6-3080-4e33-a688-b87f5aa9fadd tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Returning 404 to user: Instance ce52be6b-b276-423b-8b23-c76ff0ae73ae could not be found. {{(pid=118741) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 09:43:53.911940 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-3d7171f6-3080-4e33-a688-b87f5aa9fadd tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] 10.222.0.57 "GET /compute/v2.1/servers/ce52be6b-b276-423b-8b23-c76ff0ae73ae" status: 404 len: 111 microversion: 2.1 time: 0.028677 Jun 07 09:43:53.911940 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 594/1187] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:43:53 2022] GET /compute/v2.1/servers/ce52be6b-b276-423b-8b23-c76ff0ae73ae => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 09:43:54.007280 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-13dfc149-4e36-4ab9-8602-3a86e6e7d040 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1446696786", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-259675010", "security_groups": [{"name": "tempest-secgroup-smoke-1705282998"}], "block_device_mapping_v2": [{"uuid": "116199cb-2a91-4339-aad9-176a722c0226", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b3a7cead-e268-4715-a95d-aacec80a9aad"}]}} {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:43:54.116112 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.network.neutron [None req-13dfc149-4e36-4ab9-8602-3a86e6e7d040 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] validate_networks() for [('b3a7cead-e268-4715-a95d-aacec80a9aad', None, None, None, None, None)] {{(pid=118740) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 09:43:54.464223 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.virt.hardware [None req-13dfc149-4e36-4ab9-8602-3a86e6e7d040 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Flavor limits 0:0:0 {{(pid=118740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 09:43:54.464683 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.virt.hardware [None req-13dfc149-4e36-4ab9-8602-3a86e6e7d040 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Image limits 0:0:0 {{(pid=118740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 09:43:54.465164 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.virt.hardware [None req-13dfc149-4e36-4ab9-8602-3a86e6e7d040 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Flavor pref 0:0:0 {{(pid=118740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 09:43:54.465574 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.virt.hardware [None req-13dfc149-4e36-4ab9-8602-3a86e6e7d040 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Image pref 0:0:0 {{(pid=118740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 09:43:54.466014 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.virt.hardware [None req-13dfc149-4e36-4ab9-8602-3a86e6e7d040 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 09:43:54.476131 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-13dfc149-4e36-4ab9-8602-3a86e6e7d040 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:43:54.476575 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-13dfc149-4e36-4ab9-8602-3a86e6e7d040 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:43:54.477396 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-13dfc149-4e36-4ab9-8602-3a86e6e7d040 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:43:54.477833 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-13dfc149-4e36-4ab9-8602-3a86e6e7d040 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:43:54.494050 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.quota [None req-13dfc149-4e36-4ab9-8602-3a86e6e7d040 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Getting quotas for project 8c26e375cbb2421b8c8e34653f7d2f38. Resources: {'instances', 'cores', 'ram'} {{(pid=118740) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 09:43:54.498066 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.quota [None req-13dfc149-4e36-4ab9-8602-3a86e6e7d040 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Getting quotas for user a446f2a301a04fa485094d7be5219a07 and project 8c26e375cbb2421b8c8e34653f7d2f38. Resources: {'instances', 'cores', 'ram'} {{(pid=118740) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 09:43:54.555559 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-13dfc149-4e36-4ab9-8602-3a86e6e7d040 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Going to run 1 instances... {{(pid=118740) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 09:43:54.557765 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-13dfc149-4e36-4ab9-8602-3a86e6e7d040 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] [instance: 0cca2248-4ac0-4cad-ab8a-cbe43d6d670a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='116199cb-2a91-4339-aad9-176a722c0226',volume_size=None,volume_type=None)] {{(pid=118740) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 09:43:54.663918 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-cdbb9c74-822f-4e1b-87e6-a2daccf85810 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:43:54.664565 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-cdbb9c74-822f-4e1b-87e6-a2daccf85810 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] [instance: 06e4dfcb-5449-443b-8fa1-e52fce36cda7] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:43:54.670895 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-cdbb9c74-822f-4e1b-87e6-a2daccf85810 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:43:54.671352 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-cdbb9c74-822f-4e1b-87e6-a2daccf85810 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:43:54.672091 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-cdbb9c74-822f-4e1b-87e6-a2daccf85810 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:43:54.672526 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-cdbb9c74-822f-4e1b-87e6-a2daccf85810 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:43:54.799690 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-cdbb9c74-822f-4e1b-87e6-a2daccf85810 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4658a11ae5b740e78c4ea8e656b46212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f7583c3efc45cb83a18d3c8f3f1cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:43:54.807899 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-cdbb9c74-822f-4e1b-87e6-a2daccf85810 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] 10.222.0.57 "GET /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7" status: 200 len: 1358 microversion: 2.1 time: 0.147693 Jun 07 09:43:54.808468 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 595/1188] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:43:54 2022] GET /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7 => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:43:54.942449 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-13dfc149-4e36-4ab9-8602-3a86e6e7d040 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.938978 Jun 07 09:43:54.943100 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 594/1189] 10.222.0.57 () {60 vars in 1146 bytes} [Tue Jun 7 09:43:54 2022] POST /compute/v2.1/servers => generated 406 bytes in 940 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 09:43:54.952993 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-3664c79d-a4ec-494f-ac92-a82bbe073434 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:43:54.953606 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-3664c79d-a4ec-494f-ac92-a82bbe073434 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] [instance: 0cca2248-4ac0-4cad-ab8a-cbe43d6d670a] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:43:55.015743 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-3664c79d-a4ec-494f-ac92-a82bbe073434 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a446f2a301a04fa485094d7be5219a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c26e375cbb2421b8c8e34653f7d2f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:43:55.025491 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-3664c79d-a4ec-494f-ac92-a82bbe073434 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] 10.222.0.57 "GET /compute/v2.1/servers/0cca2248-4ac0-4cad-ab8a-cbe43d6d670a" status: 200 len: 1094 microversion: 2.1 time: 0.076272 Jun 07 09:43:55.026064 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 596/1190] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:43:54 2022] GET /compute/v2.1/servers/0cca2248-4ac0-4cad-ab8a-cbe43d6d670a => generated 1094 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:43:55.825944 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-2878b103-d9e8-4e91-890d-1dcb5a1fba61 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:43:55.826818 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-2878b103-d9e8-4e91-890d-1dcb5a1fba61 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] [instance: 06e4dfcb-5449-443b-8fa1-e52fce36cda7] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:43:55.833615 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-2878b103-d9e8-4e91-890d-1dcb5a1fba61 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:43:55.834058 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-2878b103-d9e8-4e91-890d-1dcb5a1fba61 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:43:55.834818 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-2878b103-d9e8-4e91-890d-1dcb5a1fba61 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:43:55.835248 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-2878b103-d9e8-4e91-890d-1dcb5a1fba61 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:43:55.964887 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-2878b103-d9e8-4e91-890d-1dcb5a1fba61 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4658a11ae5b740e78c4ea8e656b46212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f7583c3efc45cb83a18d3c8f3f1cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:43:55.973260 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-2878b103-d9e8-4e91-890d-1dcb5a1fba61 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] 10.222.0.57 "GET /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7" status: 200 len: 1547 microversion: 2.1 time: 0.152453 Jun 07 09:43:55.973868 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 595/1191] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:43:55 2022] GET /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7 => generated 1547 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:43:55.993427 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-f6dda107-c577-4ce2-a506-ee7b0c0385f5 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:43:55.994036 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-f6dda107-c577-4ce2-a506-ee7b0c0385f5 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] [instance: 06e4dfcb-5449-443b-8fa1-e52fce36cda7] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:43:56.001065 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-f6dda107-c577-4ce2-a506-ee7b0c0385f5 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:43:56.001509 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-f6dda107-c577-4ce2-a506-ee7b0c0385f5 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:43:56.002256 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-f6dda107-c577-4ce2-a506-ee7b0c0385f5 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:43:56.002693 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-f6dda107-c577-4ce2-a506-ee7b0c0385f5 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:43:56.042406 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-c42396aa-0b6d-4cd8-b7a6-4cb8f90a138b tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:43:56.043230 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-c42396aa-0b6d-4cd8-b7a6-4cb8f90a138b tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] [instance: 0cca2248-4ac0-4cad-ab8a-cbe43d6d670a] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:43:56.051165 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-c42396aa-0b6d-4cd8-b7a6-4cb8f90a138b tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:43:56.051620 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-c42396aa-0b6d-4cd8-b7a6-4cb8f90a138b tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:43:56.052695 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-c42396aa-0b6d-4cd8-b7a6-4cb8f90a138b tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:43:56.053178 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-c42396aa-0b6d-4cd8-b7a6-4cb8f90a138b tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:43:56.072212 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:43:56.117609 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-c42396aa-0b6d-4cd8-b7a6-4cb8f90a138b tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a446f2a301a04fa485094d7be5219a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c26e375cbb2421b8c8e34653f7d2f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:43:56.124808 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-c42396aa-0b6d-4cd8-b7a6-4cb8f90a138b tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] 10.222.0.57 "GET /compute/v2.1/servers/0cca2248-4ac0-4cad-ab8a-cbe43d6d670a" status: 200 len: 1136 microversion: 2.1 time: 0.086193 Jun 07 09:43:56.125382 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 596/1192] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:43:56 2022] GET /compute/v2.1/servers/0cca2248-4ac0-4cad-ab8a-cbe43d6d670a => generated 1136 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 09:43:56.142595 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-f6dda107-c577-4ce2-a506-ee7b0c0385f5 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4658a11ae5b740e78c4ea8e656b46212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f7583c3efc45cb83a18d3c8f3f1cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:43:56.149916 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-f6dda107-c577-4ce2-a506-ee7b0c0385f5 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] 10.222.0.57 "GET /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7" status: 200 len: 1547 microversion: 2.1 time: 0.160256 Jun 07 09:43:56.150469 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 597/1193] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:43:55 2022] GET /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7 => generated 1547 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:43:56.165263 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-852c2622-9bb2-4c1b-bc06-d440dd664e9f tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:43:56.168715 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-852c2622-9bb2-4c1b-bc06-d440dd664e9f tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4658a11ae5b740e78c4ea8e656b46212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f7583c3efc45cb83a18d3c8f3f1cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:43:56.169476 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-852c2622-9bb2-4c1b-bc06-d440dd664e9f tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Searching by: {'deleted': False, 'project_id': '17f7583c3efc45cb83a18d3c8f3f1cf6'} {{(pid=118740) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 07 09:43:56.176282 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-852c2622-9bb2-4c1b-bc06-d440dd664e9f tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:43:56.176777 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-852c2622-9bb2-4c1b-bc06-d440dd664e9f tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:43:56.177571 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-852c2622-9bb2-4c1b-bc06-d440dd664e9f tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:43:56.178035 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-852c2622-9bb2-4c1b-bc06-d440dd664e9f tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:43:56.274034 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.multi_cell_list [None req-852c2622-9bb2-4c1b-bc06-d440dd664e9f tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118740) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 07 09:43:56.417061 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-852c2622-9bb2-4c1b-bc06-d440dd664e9f tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] 10.222.0.57 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.202647 Jun 07 09:43:56.417061 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 597/1194] 10.222.0.57 () {58 vars in 1124 bytes} [Tue Jun 7 09:43:56 2022] GET /compute/v2.1/servers => generated 342 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:43:56.417415 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-b3db05a1-9637-4a71-9222-55d7a3eab4f1 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:43:56.417415 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-b3db05a1-9637-4a71-9222-55d7a3eab4f1 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] [instance: 06e4dfcb-5449-443b-8fa1-e52fce36cda7] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:43:56.417415 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b3db05a1-9637-4a71-9222-55d7a3eab4f1 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:43:56.417415 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b3db05a1-9637-4a71-9222-55d7a3eab4f1 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:43:56.417783 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b3db05a1-9637-4a71-9222-55d7a3eab4f1 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:43:56.417783 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b3db05a1-9637-4a71-9222-55d7a3eab4f1 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:43:56.508487 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-b3db05a1-9637-4a71-9222-55d7a3eab4f1 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4658a11ae5b740e78c4ea8e656b46212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f7583c3efc45cb83a18d3c8f3f1cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:43:56.512041 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writing DB stats nova_cell1:SELECT=100 {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:43:56.516376 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-b3db05a1-9637-4a71-9222-55d7a3eab4f1 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] 10.222.0.57 "GET /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7" status: 200 len: 1547 microversion: 2.1 time: 0.145251 Jun 07 09:43:56.517563 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 598/1195] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:43:56 2022] GET /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7 => generated 1547 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:43:57.143075 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-a2bd6f33-c6d1-432a-95a2-cc4168d1ae5e tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:43:57.144283 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-a2bd6f33-c6d1-432a-95a2-cc4168d1ae5e tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] [instance: 0cca2248-4ac0-4cad-ab8a-cbe43d6d670a] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:43:57.155836 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-a2bd6f33-c6d1-432a-95a2-cc4168d1ae5e tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:43:57.155836 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-a2bd6f33-c6d1-432a-95a2-cc4168d1ae5e tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:43:57.155836 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-a2bd6f33-c6d1-432a-95a2-cc4168d1ae5e tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:43:57.155836 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-a2bd6f33-c6d1-432a-95a2-cc4168d1ae5e tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:43:57.239483 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-a2bd6f33-c6d1-432a-95a2-cc4168d1ae5e tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a446f2a301a04fa485094d7be5219a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c26e375cbb2421b8c8e34653f7d2f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:43:57.247013 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-a2bd6f33-c6d1-432a-95a2-cc4168d1ae5e tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] 10.222.0.57 "GET /compute/v2.1/servers/0cca2248-4ac0-4cad-ab8a-cbe43d6d670a" status: 200 len: 1210 microversion: 2.1 time: 0.108984 Jun 07 09:43:57.251312 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 598/1196] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:43:57 2022] GET /compute/v2.1/servers/0cca2248-4ac0-4cad-ab8a-cbe43d6d670a => generated 1210 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:43:58.265834 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-d3274d20-fdd9-4dce-a278-b5742bb75363 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:43:58.266452 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-d3274d20-fdd9-4dce-a278-b5742bb75363 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] [instance: 0cca2248-4ac0-4cad-ab8a-cbe43d6d670a] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:43:58.274009 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-d3274d20-fdd9-4dce-a278-b5742bb75363 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:43:58.274547 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-d3274d20-fdd9-4dce-a278-b5742bb75363 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:43:58.275309 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-d3274d20-fdd9-4dce-a278-b5742bb75363 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:43:58.275792 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-d3274d20-fdd9-4dce-a278-b5742bb75363 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:43:58.466552 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-835e47d6-fe43-4eef-83a7-c2cf9ea749eb tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a43ce64e-b213-4f7e-be06-927aa33949e8"}} {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:43:58.467780 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-835e47d6-fe43-4eef-83a7-c2cf9ea749eb tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] [instance: 06e4dfcb-5449-443b-8fa1-e52fce36cda7] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:43:58.478110 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-835e47d6-fe43-4eef-83a7-c2cf9ea749eb tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:43:58.479083 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-835e47d6-fe43-4eef-83a7-c2cf9ea749eb tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:43:58.480270 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-835e47d6-fe43-4eef-83a7-c2cf9ea749eb tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:43:58.481712 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-835e47d6-fe43-4eef-83a7-c2cf9ea749eb tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:43:58.517912 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-d3274d20-fdd9-4dce-a278-b5742bb75363 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a446f2a301a04fa485094d7be5219a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c26e375cbb2421b8c8e34653f7d2f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:43:58.529586 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-d3274d20-fdd9-4dce-a278-b5742bb75363 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] 10.222.0.57 "GET /compute/v2.1/servers/0cca2248-4ac0-4cad-ab8a-cbe43d6d670a" status: 200 len: 1278 microversion: 2.1 time: 0.267948 Jun 07 09:43:58.530540 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 599/1197] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:43:58 2022] GET /compute/v2.1/servers/0cca2248-4ac0-4cad-ab8a-cbe43d6d670a => generated 1278 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:43:58.779445 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [req-2eef7b94-6c42-435a-ae1f-c6c22e0c3667 req-5ee08107-f163-4eaa-92c1-f81fbcb3a755 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cca2248-4ac0-4cad-ab8a-cbe43d6d670a", "tag": "ba1d289e-e5c1-44ac-a3db-cc25783eaf2f"}]} {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:43:58.787927 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [req-2eef7b94-6c42-435a-ae1f-c6c22e0c3667 req-5ee08107-f163-4eaa-92c1-f81fbcb3a755 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:43:58.789274 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [req-2eef7b94-6c42-435a-ae1f-c6c22e0c3667 req-5ee08107-f163-4eaa-92c1-f81fbcb3a755 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:43:58.809087 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.compute.server_external_events [req-2eef7b94-6c42-435a-ae1f-c6c22e0c3667 req-5ee08107-f163-4eaa-92c1-f81fbcb3a755 service nova] Creating event network-changed:ba1d289e-e5c1-44ac-a3db-cc25783eaf2f for instance 0cca2248-4ac0-4cad-ab8a-cbe43d6d670a on hv-cinder-83699 Jun 07 09:43:58.814647 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [req-2eef7b94-6c42-435a-ae1f-c6c22e0c3667 req-5ee08107-f163-4eaa-92c1-f81fbcb3a755 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038535 Jun 07 09:43:58.815249 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 600/1198] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Jun 7 09:43:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:43:59.363452 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-835e47d6-fe43-4eef-83a7-c2cf9ea749eb tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] 10.222.0.57 "POST /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.900684 Jun 07 09:43:59.364268 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 599/1199] 10.222.0.57 () {60 vars in 1322 bytes} [Tue Jun 7 09:43:58 2022] POST /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7/os-volume_attachments => generated 194 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 09:43:59.547224 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-612351bc-75a0-49cc-bde5-478282c7e325 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:43:59.547995 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-612351bc-75a0-49cc-bde5-478282c7e325 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] [instance: 0cca2248-4ac0-4cad-ab8a-cbe43d6d670a] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:43:59.554388 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-612351bc-75a0-49cc-bde5-478282c7e325 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:43:59.554840 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-612351bc-75a0-49cc-bde5-478282c7e325 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:43:59.555595 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-612351bc-75a0-49cc-bde5-478282c7e325 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:43:59.556025 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-612351bc-75a0-49cc-bde5-478282c7e325 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:43:59.695494 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-612351bc-75a0-49cc-bde5-478282c7e325 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a446f2a301a04fa485094d7be5219a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c26e375cbb2421b8c8e34653f7d2f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:43:59.702920 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-612351bc-75a0-49cc-bde5-478282c7e325 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] 10.222.0.57 "GET /compute/v2.1/servers/0cca2248-4ac0-4cad-ab8a-cbe43d6d670a" status: 200 len: 1266 microversion: 2.1 time: 0.160450 Jun 07 09:43:59.703700 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 601/1200] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:43:59 2022] GET /compute/v2.1/servers/0cca2248-4ac0-4cad-ab8a-cbe43d6d670a => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:44:00.721910 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-c0ffacae-0eb9-4d70-9615-c11d793da125 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:44:00.722548 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-c0ffacae-0eb9-4d70-9615-c11d793da125 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] [instance: 0cca2248-4ac0-4cad-ab8a-cbe43d6d670a] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:44:00.725021 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:44:00.730037 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-c0ffacae-0eb9-4d70-9615-c11d793da125 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:44:00.730493 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-c0ffacae-0eb9-4d70-9615-c11d793da125 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:44:00.731254 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-c0ffacae-0eb9-4d70-9615-c11d793da125 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:44:00.731695 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-c0ffacae-0eb9-4d70-9615-c11d793da125 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:44:00.863888 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-c0ffacae-0eb9-4d70-9615-c11d793da125 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a446f2a301a04fa485094d7be5219a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c26e375cbb2421b8c8e34653f7d2f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:44:00.871265 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-c0ffacae-0eb9-4d70-9615-c11d793da125 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] 10.222.0.57 "GET /compute/v2.1/servers/0cca2248-4ac0-4cad-ab8a-cbe43d6d670a" status: 200 len: 1266 microversion: 2.1 time: 0.154520 Jun 07 09:44:00.871830 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 600/1201] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:44:00 2022] GET /compute/v2.1/servers/0cca2248-4ac0-4cad-ab8a-cbe43d6d670a => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:44:01.887479 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-e468ac80-317e-4988-a35e-109b2ecca39b tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:44:01.888171 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-e468ac80-317e-4988-a35e-109b2ecca39b tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] [instance: 0cca2248-4ac0-4cad-ab8a-cbe43d6d670a] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:44:01.890729 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=1 {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:44:01.896337 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-e468ac80-317e-4988-a35e-109b2ecca39b tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:44:01.896878 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-e468ac80-317e-4988-a35e-109b2ecca39b tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:44:01.897646 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-e468ac80-317e-4988-a35e-109b2ecca39b tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:44:01.898084 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-e468ac80-317e-4988-a35e-109b2ecca39b tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:44:02.033393 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-e468ac80-317e-4988-a35e-109b2ecca39b tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a446f2a301a04fa485094d7be5219a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c26e375cbb2421b8c8e34653f7d2f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:44:02.041595 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-e468ac80-317e-4988-a35e-109b2ecca39b tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] 10.222.0.57 "GET /compute/v2.1/servers/0cca2248-4ac0-4cad-ab8a-cbe43d6d670a" status: 200 len: 1266 microversion: 2.1 time: 0.158044 Jun 07 09:44:02.042147 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 602/1202] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:44:01 2022] GET /compute/v2.1/servers/0cca2248-4ac0-4cad-ab8a-cbe43d6d670a => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:44:03.058294 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-53b8ee58-6ab7-47a1-8a36-d0a15b1f784c tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:44:03.058899 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-53b8ee58-6ab7-47a1-8a36-d0a15b1f784c tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] [instance: 0cca2248-4ac0-4cad-ab8a-cbe43d6d670a] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:44:03.065360 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-53b8ee58-6ab7-47a1-8a36-d0a15b1f784c tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:44:03.065804 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-53b8ee58-6ab7-47a1-8a36-d0a15b1f784c tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:44:03.066553 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-53b8ee58-6ab7-47a1-8a36-d0a15b1f784c tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:44:03.067000 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-53b8ee58-6ab7-47a1-8a36-d0a15b1f784c tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:44:03.192301 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-53b8ee58-6ab7-47a1-8a36-d0a15b1f784c tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a446f2a301a04fa485094d7be5219a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c26e375cbb2421b8c8e34653f7d2f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:44:03.199817 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-53b8ee58-6ab7-47a1-8a36-d0a15b1f784c tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] 10.222.0.57 "GET /compute/v2.1/servers/0cca2248-4ac0-4cad-ab8a-cbe43d6d670a" status: 200 len: 1266 microversion: 2.1 time: 0.145390 Jun 07 09:44:03.200380 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 601/1203] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:44:03 2022] GET /compute/v2.1/servers/0cca2248-4ac0-4cad-ab8a-cbe43d6d670a => generated 1266 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:44:04.216504 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-8e908f02-2e10-44ce-a846-f6c161934c66 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:44:04.217149 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-8e908f02-2e10-44ce-a846-f6c161934c66 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] [instance: 0cca2248-4ac0-4cad-ab8a-cbe43d6d670a] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:44:04.224491 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-8e908f02-2e10-44ce-a846-f6c161934c66 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:44:04.224974 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-8e908f02-2e10-44ce-a846-f6c161934c66 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:44:04.225734 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-8e908f02-2e10-44ce-a846-f6c161934c66 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:44:04.226173 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-8e908f02-2e10-44ce-a846-f6c161934c66 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:44:04.351009 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-8e908f02-2e10-44ce-a846-f6c161934c66 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a446f2a301a04fa485094d7be5219a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c26e375cbb2421b8c8e34653f7d2f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:44:04.358422 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-8e908f02-2e10-44ce-a846-f6c161934c66 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] 10.222.0.57 "GET /compute/v2.1/servers/0cca2248-4ac0-4cad-ab8a-cbe43d6d670a" status: 200 len: 1266 microversion: 2.1 time: 0.145734 Jun 07 09:44:04.358981 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 603/1204] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:44:04 2022] GET /compute/v2.1/servers/0cca2248-4ac0-4cad-ab8a-cbe43d6d670a => generated 1266 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:44:05.374941 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-0ff0b17b-1864-4cfb-8204-6b37aeda1ccb tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:44:05.376996 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-0ff0b17b-1864-4cfb-8204-6b37aeda1ccb tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] [instance: 0cca2248-4ac0-4cad-ab8a-cbe43d6d670a] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:44:05.378868 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writing DB stats nova_cell0:SELECT=6 {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:44:05.382355 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-0ff0b17b-1864-4cfb-8204-6b37aeda1ccb tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:44:05.382811 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-0ff0b17b-1864-4cfb-8204-6b37aeda1ccb tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:44:05.383565 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-0ff0b17b-1864-4cfb-8204-6b37aeda1ccb tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:44:05.384000 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-0ff0b17b-1864-4cfb-8204-6b37aeda1ccb tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:44:05.513516 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-0ff0b17b-1864-4cfb-8204-6b37aeda1ccb tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a446f2a301a04fa485094d7be5219a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c26e375cbb2421b8c8e34653f7d2f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:44:05.521126 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-0ff0b17b-1864-4cfb-8204-6b37aeda1ccb tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] 10.222.0.57 "GET /compute/v2.1/servers/0cca2248-4ac0-4cad-ab8a-cbe43d6d670a" status: 200 len: 1266 microversion: 2.1 time: 0.149918 Jun 07 09:44:05.522253 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 602/1205] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:44:05 2022] GET /compute/v2.1/servers/0cca2248-4ac0-4cad-ab8a-cbe43d6d670a => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:44:06.538938 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-1d7d414e-4d3e-47ce-a26c-d38f829e28ab tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:44:06.539539 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-1d7d414e-4d3e-47ce-a26c-d38f829e28ab tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] [instance: 0cca2248-4ac0-4cad-ab8a-cbe43d6d670a] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:44:06.541460 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writing DB stats nova_cell0:SELECT=2 {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:44:06.546717 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-1d7d414e-4d3e-47ce-a26c-d38f829e28ab tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:44:06.547159 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-1d7d414e-4d3e-47ce-a26c-d38f829e28ab tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:44:06.547909 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-1d7d414e-4d3e-47ce-a26c-d38f829e28ab tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:44:06.548338 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-1d7d414e-4d3e-47ce-a26c-d38f829e28ab tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:44:06.679296 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-1d7d414e-4d3e-47ce-a26c-d38f829e28ab tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a446f2a301a04fa485094d7be5219a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c26e375cbb2421b8c8e34653f7d2f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:44:06.686732 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-1d7d414e-4d3e-47ce-a26c-d38f829e28ab tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] 10.222.0.57 "GET /compute/v2.1/servers/0cca2248-4ac0-4cad-ab8a-cbe43d6d670a" status: 200 len: 1266 microversion: 2.1 time: 0.152096 Jun 07 09:44:06.687309 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 604/1206] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:44:06 2022] GET /compute/v2.1/servers/0cca2248-4ac0-4cad-ab8a-cbe43d6d670a => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:44:07.703392 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-06be6256-2dc2-446f-b637-c2677bcf92d6 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:44:07.703930 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-06be6256-2dc2-446f-b637-c2677bcf92d6 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] [instance: 0cca2248-4ac0-4cad-ab8a-cbe43d6d670a] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:44:07.705776 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writing DB stats nova_cell0:SELECT=4 {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:44:07.711063 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-06be6256-2dc2-446f-b637-c2677bcf92d6 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:44:07.711509 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-06be6256-2dc2-446f-b637-c2677bcf92d6 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:44:07.712298 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-06be6256-2dc2-446f-b637-c2677bcf92d6 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:44:07.712763 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-06be6256-2dc2-446f-b637-c2677bcf92d6 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:44:07.857098 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-06be6256-2dc2-446f-b637-c2677bcf92d6 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a446f2a301a04fa485094d7be5219a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c26e375cbb2421b8c8e34653f7d2f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:44:07.860162 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-06be6256-2dc2-446f-b637-c2677bcf92d6 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] 10.222.0.57 "GET /compute/v2.1/servers/0cca2248-4ac0-4cad-ab8a-cbe43d6d670a" status: 200 len: 1266 microversion: 2.1 time: 0.160807 Jun 07 09:44:07.860763 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 603/1207] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:44:07 2022] GET /compute/v2.1/servers/0cca2248-4ac0-4cad-ab8a-cbe43d6d670a => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:44:07.955648 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-76bfc682-1735-4741-bc8c-70a975862716 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:44:07.956376 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-76bfc682-1735-4741-bc8c-70a975862716 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] [instance: 06e4dfcb-5449-443b-8fa1-e52fce36cda7] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:44:07.963049 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-76bfc682-1735-4741-bc8c-70a975862716 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:44:07.963494 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-76bfc682-1735-4741-bc8c-70a975862716 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:44:07.964248 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-76bfc682-1735-4741-bc8c-70a975862716 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:44:07.964738 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-76bfc682-1735-4741-bc8c-70a975862716 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:44:08.089591 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-76bfc682-1735-4741-bc8c-70a975862716 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4658a11ae5b740e78c4ea8e656b46212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f7583c3efc45cb83a18d3c8f3f1cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:44:08.097737 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-76bfc682-1735-4741-bc8c-70a975862716 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] 10.222.0.57 "GET /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7" status: 200 len: 1593 microversion: 2.1 time: 0.146069 Jun 07 09:44:08.098301 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 605/1208] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:44:07 2022] GET /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7 => generated 1593 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:44:08.876782 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-95aac050-b173-4fc5-9236-cf81bce5f13c tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:44:08.877395 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-95aac050-b173-4fc5-9236-cf81bce5f13c tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] [instance: 0cca2248-4ac0-4cad-ab8a-cbe43d6d670a] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:44:08.884988 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-95aac050-b173-4fc5-9236-cf81bce5f13c tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:44:08.885437 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-95aac050-b173-4fc5-9236-cf81bce5f13c tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:44:08.886299 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-95aac050-b173-4fc5-9236-cf81bce5f13c tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:44:08.886750 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-95aac050-b173-4fc5-9236-cf81bce5f13c tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:44:09.029081 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-95aac050-b173-4fc5-9236-cf81bce5f13c tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a446f2a301a04fa485094d7be5219a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c26e375cbb2421b8c8e34653f7d2f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:44:09.036991 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-95aac050-b173-4fc5-9236-cf81bce5f13c tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] 10.222.0.57 "GET /compute/v2.1/servers/0cca2248-4ac0-4cad-ab8a-cbe43d6d670a" status: 200 len: 1266 microversion: 2.1 time: 0.164063 Jun 07 09:44:09.037818 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 604/1209] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:44:08 2022] GET /compute/v2.1/servers/0cca2248-4ac0-4cad-ab8a-cbe43d6d670a => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:44:09.059708 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [req-44cf53f0-3c41-48f7-a71b-3035b8e60b5b req-fe8968a9-8a49-4de3-bac6-681824f07f21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cca2248-4ac0-4cad-ab8a-cbe43d6d670a", "name": "network-vif-plugged", "status": "completed", "tag": "ba1d289e-e5c1-44ac-a3db-cc25783eaf2f"}]} {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:44:09.069795 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [req-44cf53f0-3c41-48f7-a71b-3035b8e60b5b req-fe8968a9-8a49-4de3-bac6-681824f07f21 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:44:09.070243 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [req-44cf53f0-3c41-48f7-a71b-3035b8e60b5b req-fe8968a9-8a49-4de3-bac6-681824f07f21 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:44:09.081906 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.compute.server_external_events [req-44cf53f0-3c41-48f7-a71b-3035b8e60b5b req-fe8968a9-8a49-4de3-bac6-681824f07f21 service nova] Creating event network-vif-plugged:ba1d289e-e5c1-44ac-a3db-cc25783eaf2f for instance 0cca2248-4ac0-4cad-ab8a-cbe43d6d670a on hv-cinder-83699 Jun 07 09:44:09.087199 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [req-44cf53f0-3c41-48f7-a71b-3035b8e60b5b req-fe8968a9-8a49-4de3-bac6-681824f07f21 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031753 Jun 07 09:44:09.088061 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 606/1210] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Jun 7 09:44:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:44:10.053774 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-b1cdb0c6-1d62-47a5-a698-ae0181afb04b tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:44:10.054392 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-b1cdb0c6-1d62-47a5-a698-ae0181afb04b tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] [instance: 0cca2248-4ac0-4cad-ab8a-cbe43d6d670a] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:44:10.060802 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b1cdb0c6-1d62-47a5-a698-ae0181afb04b tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:44:10.061258 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b1cdb0c6-1d62-47a5-a698-ae0181afb04b tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:44:10.062016 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b1cdb0c6-1d62-47a5-a698-ae0181afb04b tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:44:10.062457 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b1cdb0c6-1d62-47a5-a698-ae0181afb04b tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:44:10.192617 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-b1cdb0c6-1d62-47a5-a698-ae0181afb04b tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a446f2a301a04fa485094d7be5219a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c26e375cbb2421b8c8e34653f7d2f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:44:10.200698 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-b1cdb0c6-1d62-47a5-a698-ae0181afb04b tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] 10.222.0.57 "GET /compute/v2.1/servers/0cca2248-4ac0-4cad-ab8a-cbe43d6d670a" status: 200 len: 1266 microversion: 2.1 time: 0.151188 Jun 07 09:44:10.201257 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 605/1211] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:44:10 2022] GET /compute/v2.1/servers/0cca2248-4ac0-4cad-ab8a-cbe43d6d670a => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:44:10.309698 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [req-b97cc965-fd2c-49d1-845c-0b1ac682bb2c req-97b1859b-72f6-4962-8357-1023c6e2b382 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06e4dfcb-5449-443b-8fa1-e52fce36cda7", "tag": "7d0625d7-0de3-40be-af38-c06ed2b15941"}]} {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:44:10.317971 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [req-b97cc965-fd2c-49d1-845c-0b1ac682bb2c req-97b1859b-72f6-4962-8357-1023c6e2b382 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:44:10.318419 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [req-b97cc965-fd2c-49d1-845c-0b1ac682bb2c req-97b1859b-72f6-4962-8357-1023c6e2b382 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:44:10.329448 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.compute.server_external_events [req-b97cc965-fd2c-49d1-845c-0b1ac682bb2c req-97b1859b-72f6-4962-8357-1023c6e2b382 service nova] Creating event network-changed:7d0625d7-0de3-40be-af38-c06ed2b15941 for instance 06e4dfcb-5449-443b-8fa1-e52fce36cda7 on hv-cinder-83699 Jun 07 09:44:10.334226 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [req-b97cc965-fd2c-49d1-845c-0b1ac682bb2c req-97b1859b-72f6-4962-8357-1023c6e2b382 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028944 Jun 07 09:44:10.334808 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 607/1212] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Jun 7 09:44:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:44:11.217297 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-1229bb91-a926-405a-8002-bd43d62567c0 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:44:11.217890 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-1229bb91-a926-405a-8002-bd43d62567c0 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] [instance: 0cca2248-4ac0-4cad-ab8a-cbe43d6d670a] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:44:11.228794 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-1229bb91-a926-405a-8002-bd43d62567c0 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:44:11.229298 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-1229bb91-a926-405a-8002-bd43d62567c0 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:44:11.230148 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-1229bb91-a926-405a-8002-bd43d62567c0 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:44:11.230581 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-1229bb91-a926-405a-8002-bd43d62567c0 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:44:11.408239 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-1229bb91-a926-405a-8002-bd43d62567c0 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a446f2a301a04fa485094d7be5219a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c26e375cbb2421b8c8e34653f7d2f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:44:11.418341 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-1229bb91-a926-405a-8002-bd43d62567c0 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] 10.222.0.57 "GET /compute/v2.1/servers/0cca2248-4ac0-4cad-ab8a-cbe43d6d670a" status: 200 len: 1266 microversion: 2.1 time: 0.205024 Jun 07 09:44:11.419766 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 606/1213] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:44:11 2022] GET /compute/v2.1/servers/0cca2248-4ac0-4cad-ab8a-cbe43d6d670a => generated 1266 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:44:12.439586 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-82f63d70-ab48-427f-84a1-acc6bcd2c236 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:44:12.440295 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-82f63d70-ab48-427f-84a1-acc6bcd2c236 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] [instance: 0cca2248-4ac0-4cad-ab8a-cbe43d6d670a] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:44:12.446480 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-82f63d70-ab48-427f-84a1-acc6bcd2c236 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:44:12.451123 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-82f63d70-ab48-427f-84a1-acc6bcd2c236 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:44:12.451123 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-82f63d70-ab48-427f-84a1-acc6bcd2c236 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:44:12.451123 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-82f63d70-ab48-427f-84a1-acc6bcd2c236 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:44:12.581908 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-82f63d70-ab48-427f-84a1-acc6bcd2c236 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a446f2a301a04fa485094d7be5219a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c26e375cbb2421b8c8e34653f7d2f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:44:12.590436 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-82f63d70-ab48-427f-84a1-acc6bcd2c236 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] 10.222.0.57 "GET /compute/v2.1/servers/0cca2248-4ac0-4cad-ab8a-cbe43d6d670a" status: 200 len: 1452 microversion: 2.1 time: 0.155607 Jun 07 09:44:12.590995 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 608/1214] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:44:12 2022] GET /compute/v2.1/servers/0cca2248-4ac0-4cad-ab8a-cbe43d6d670a => generated 1452 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:44:12.606574 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-000b6438-eaad-4461-876f-908ebb49b98b tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:44:12.607193 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-000b6438-eaad-4461-876f-908ebb49b98b tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] [instance: 0cca2248-4ac0-4cad-ab8a-cbe43d6d670a] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:44:12.613730 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-000b6438-eaad-4461-876f-908ebb49b98b tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:44:12.614336 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-000b6438-eaad-4461-876f-908ebb49b98b tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:44:12.615131 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-000b6438-eaad-4461-876f-908ebb49b98b tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:44:12.615576 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-000b6438-eaad-4461-876f-908ebb49b98b tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:44:12.654413 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-14583685-016f-48d5-a1a4-fb9424b1b7c4 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1887495003"}} {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:44:12.654902 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-14583685-016f-48d5-a1a4-fb9424b1b7c4 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] [instance: 06e4dfcb-5449-443b-8fa1-e52fce36cda7] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:44:12.661003 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-14583685-016f-48d5-a1a4-fb9424b1b7c4 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:44:12.661512 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-14583685-016f-48d5-a1a4-fb9424b1b7c4 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:44:12.668385 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-14583685-016f-48d5-a1a4-fb9424b1b7c4 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:44:12.668385 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-14583685-016f-48d5-a1a4-fb9424b1b7c4 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:44:12.743929 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-000b6438-eaad-4461-876f-908ebb49b98b tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a446f2a301a04fa485094d7be5219a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c26e375cbb2421b8c8e34653f7d2f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:44:12.751547 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-000b6438-eaad-4461-876f-908ebb49b98b tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] 10.222.0.57 "GET /compute/v2.1/servers/0cca2248-4ac0-4cad-ab8a-cbe43d6d670a" status: 200 len: 1452 microversion: 2.1 time: 0.148795 Jun 07 09:44:12.752117 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 607/1215] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:44:12 2022] GET /compute/v2.1/servers/0cca2248-4ac0-4cad-ab8a-cbe43d6d670a => generated 1452 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:44:12.794542 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.network.security_group_api [None req-14583685-016f-48d5-a1a4-fb9424b1b7c4 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Adding security group 822b41bf-ca68-4aa8-9740-d42cfd6d77e3 to port 7d0625d7-0de3-40be-af38-c06ed2b15941 Jun 07 09:44:13.690762 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-14583685-016f-48d5-a1a4-fb9424b1b7c4 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] 10.222.0.57 "POST /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7/action" status: 202 len: 0 microversion: 2.1 time: 1.038190 Jun 07 09:44:13.697129 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 609/1216] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Jun 7 09:44:12 2022] POST /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7/action => generated 0 bytes in 1047 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 07 09:44:13.698878 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [req-8cbb892f-50cd-459d-a81d-06a56404c8d3 req-82c51d60-8ca2-4e16-b545-b20a16868541 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06e4dfcb-5449-443b-8fa1-e52fce36cda7", "tag": "7d0625d7-0de3-40be-af38-c06ed2b15941"}]} {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:44:13.709504 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [req-8cbb892f-50cd-459d-a81d-06a56404c8d3 req-82c51d60-8ca2-4e16-b545-b20a16868541 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:44:13.709950 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [req-8cbb892f-50cd-459d-a81d-06a56404c8d3 req-82c51d60-8ca2-4e16-b545-b20a16868541 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:44:13.715719 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-884f1993-63b6-4718-953f-848136454fb8 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:44:13.716943 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-884f1993-63b6-4718-953f-848136454fb8 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] [instance: 06e4dfcb-5449-443b-8fa1-e52fce36cda7] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:44:13.729870 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.compute.server_external_events [req-8cbb892f-50cd-459d-a81d-06a56404c8d3 req-82c51d60-8ca2-4e16-b545-b20a16868541 service nova] Creating event network-changed:7d0625d7-0de3-40be-af38-c06ed2b15941 for instance 06e4dfcb-5449-443b-8fa1-e52fce36cda7 on hv-cinder-83699 Jun 07 09:44:13.737465 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-884f1993-63b6-4718-953f-848136454fb8 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:44:13.737922 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-884f1993-63b6-4718-953f-848136454fb8 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:44:13.738721 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-884f1993-63b6-4718-953f-848136454fb8 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:44:13.739152 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-884f1993-63b6-4718-953f-848136454fb8 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:44:13.741883 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [req-8cbb892f-50cd-459d-a81d-06a56404c8d3 req-82c51d60-8ca2-4e16-b545-b20a16868541 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047289 Jun 07 09:44:13.743094 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 608/1217] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Jun 7 09:44:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 09:44:14.022980 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-884f1993-63b6-4718-953f-848136454fb8 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4658a11ae5b740e78c4ea8e656b46212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f7583c3efc45cb83a18d3c8f3f1cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:44:14.032320 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-884f1993-63b6-4718-953f-848136454fb8 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] 10.222.0.57 "GET /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7" status: 200 len: 1758 microversion: 2.1 time: 0.333305 Jun 07 09:44:14.050733 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 610/1218] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:44:13 2022] GET /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7 => generated 1758 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:44:15.162895 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [req-55b96e6c-4489-45ee-9f20-6bf05c0dbb2c req-b8915fbc-57bc-4fa3-9743-37acccd7cab4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cca2248-4ac0-4cad-ab8a-cbe43d6d670a", "tag": "ba1d289e-e5c1-44ac-a3db-cc25783eaf2f"}]} {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:44:15.171071 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [req-55b96e6c-4489-45ee-9f20-6bf05c0dbb2c req-b8915fbc-57bc-4fa3-9743-37acccd7cab4 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:44:15.171515 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [req-55b96e6c-4489-45ee-9f20-6bf05c0dbb2c req-b8915fbc-57bc-4fa3-9743-37acccd7cab4 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:44:15.182761 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.compute.server_external_events [req-55b96e6c-4489-45ee-9f20-6bf05c0dbb2c req-b8915fbc-57bc-4fa3-9743-37acccd7cab4 service nova] Creating event network-changed:ba1d289e-e5c1-44ac-a3db-cc25783eaf2f for instance 0cca2248-4ac0-4cad-ab8a-cbe43d6d670a on hv-cinder-83699 Jun 07 09:44:15.187576 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [req-55b96e6c-4489-45ee-9f20-6bf05c0dbb2c req-b8915fbc-57bc-4fa3-9743-37acccd7cab4 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088260 Jun 07 09:44:15.191151 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 609/1219] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Jun 7 09:44:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:45:02.154839 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-b49841ce-bec9-48a2-94c2-e4b7d5573621 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:45:02.155781 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-b49841ce-bec9-48a2-94c2-e4b7d5573621 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] [instance: 06e4dfcb-5449-443b-8fa1-e52fce36cda7] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:45:02.158106 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writing DB stats nova_api:SELECT=17 {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:45:02.158923 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writing DB stats nova_cell1:SELECT=58 {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:45:02.163521 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b49841ce-bec9-48a2-94c2-e4b7d5573621 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:45:02.163974 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b49841ce-bec9-48a2-94c2-e4b7d5573621 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:45:02.164775 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b49841ce-bec9-48a2-94c2-e4b7d5573621 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:45:02.165215 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-b49841ce-bec9-48a2-94c2-e4b7d5573621 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:45:02.353342 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-b49841ce-bec9-48a2-94c2-e4b7d5573621 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] 10.222.0.57 "POST /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7/action" status: 202 len: 0 microversion: 2.1 time: 0.202798 Jun 07 09:45:02.354129 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 611/1220] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Jun 7 09:45:02 2022] POST /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7/action => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 09:45:02.360975 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writing DB stats nova_api:SELECT=19 {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:45:02.361977 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:45:02.365832 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-6c413728-7fb8-494a-ab60-7e61fd6146c2 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:45:02.366647 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-6c413728-7fb8-494a-ab60-7e61fd6146c2 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] [instance: 06e4dfcb-5449-443b-8fa1-e52fce36cda7] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:45:02.372674 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-6c413728-7fb8-494a-ab60-7e61fd6146c2 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:45:02.373131 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-6c413728-7fb8-494a-ab60-7e61fd6146c2 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:45:02.373894 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-6c413728-7fb8-494a-ab60-7e61fd6146c2 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:45:02.374332 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-6c413728-7fb8-494a-ab60-7e61fd6146c2 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:45:02.517991 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-6c413728-7fb8-494a-ab60-7e61fd6146c2 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4658a11ae5b740e78c4ea8e656b46212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f7583c3efc45cb83a18d3c8f3f1cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:45:02.525924 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-6c413728-7fb8-494a-ab60-7e61fd6146c2 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] 10.222.0.57 "GET /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7" status: 200 len: 1750 microversion: 2.1 time: 0.166975 Jun 07 09:45:02.526549 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 610/1221] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:45:02 2022] GET /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7 => generated 1750 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:45:03.545104 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-bb830275-1b57-4223-9c8a-d99907e0e98c tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:45:03.545718 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-bb830275-1b57-4223-9c8a-d99907e0e98c tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] [instance: 06e4dfcb-5449-443b-8fa1-e52fce36cda7] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:45:03.551838 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-bb830275-1b57-4223-9c8a-d99907e0e98c tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:45:03.552276 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-bb830275-1b57-4223-9c8a-d99907e0e98c tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:45:03.553058 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-bb830275-1b57-4223-9c8a-d99907e0e98c tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:45:03.559337 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-bb830275-1b57-4223-9c8a-d99907e0e98c tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:45:03.695565 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-bb830275-1b57-4223-9c8a-d99907e0e98c tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4658a11ae5b740e78c4ea8e656b46212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f7583c3efc45cb83a18d3c8f3f1cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:45:03.703532 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-bb830275-1b57-4223-9c8a-d99907e0e98c tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] 10.222.0.57 "GET /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7" status: 200 len: 1755 microversion: 2.1 time: 0.163981 Jun 07 09:45:03.704099 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 612/1222] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:45:03 2022] GET /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7 => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:45:04.721527 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-920dcc90-2047-4353-aeb0-44a691475322 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:45:04.722151 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-920dcc90-2047-4353-aeb0-44a691475322 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] [instance: 06e4dfcb-5449-443b-8fa1-e52fce36cda7] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:45:04.728995 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-920dcc90-2047-4353-aeb0-44a691475322 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:45:04.729457 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-920dcc90-2047-4353-aeb0-44a691475322 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:45:04.730223 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-920dcc90-2047-4353-aeb0-44a691475322 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:45:04.730665 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-920dcc90-2047-4353-aeb0-44a691475322 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:45:04.875121 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-920dcc90-2047-4353-aeb0-44a691475322 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4658a11ae5b740e78c4ea8e656b46212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f7583c3efc45cb83a18d3c8f3f1cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:45:04.882911 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-920dcc90-2047-4353-aeb0-44a691475322 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] 10.222.0.57 "GET /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7" status: 200 len: 1755 microversion: 2.1 time: 0.165945 Jun 07 09:45:04.883474 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 611/1223] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:45:04 2022] GET /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7 => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:45:05.900735 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-44f95b76-4695-45ee-bc9b-30fc48519081 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:45:05.901346 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-44f95b76-4695-45ee-bc9b-30fc48519081 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] [instance: 06e4dfcb-5449-443b-8fa1-e52fce36cda7] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:45:05.907864 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-44f95b76-4695-45ee-bc9b-30fc48519081 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:45:05.908313 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-44f95b76-4695-45ee-bc9b-30fc48519081 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:45:05.909094 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-44f95b76-4695-45ee-bc9b-30fc48519081 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:45:05.909528 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-44f95b76-4695-45ee-bc9b-30fc48519081 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:45:06.046829 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-44f95b76-4695-45ee-bc9b-30fc48519081 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4658a11ae5b740e78c4ea8e656b46212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f7583c3efc45cb83a18d3c8f3f1cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:45:06.054696 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-44f95b76-4695-45ee-bc9b-30fc48519081 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] 10.222.0.57 "GET /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7" status: 200 len: 1755 microversion: 2.1 time: 0.157868 Jun 07 09:45:06.055253 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 613/1224] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:45:05 2022] GET /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7 => generated 1755 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:45:07.072413 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-6ce08b33-95e7-427a-a59d-1809cd7ac9e6 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:45:07.073047 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-6ce08b33-95e7-427a-a59d-1809cd7ac9e6 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] [instance: 06e4dfcb-5449-443b-8fa1-e52fce36cda7] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:45:07.079462 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-6ce08b33-95e7-427a-a59d-1809cd7ac9e6 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:45:07.079909 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-6ce08b33-95e7-427a-a59d-1809cd7ac9e6 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:45:07.080689 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-6ce08b33-95e7-427a-a59d-1809cd7ac9e6 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:45:07.081126 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-6ce08b33-95e7-427a-a59d-1809cd7ac9e6 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:45:07.217140 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-6ce08b33-95e7-427a-a59d-1809cd7ac9e6 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4658a11ae5b740e78c4ea8e656b46212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f7583c3efc45cb83a18d3c8f3f1cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:45:07.225169 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-6ce08b33-95e7-427a-a59d-1809cd7ac9e6 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] 10.222.0.57 "GET /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7" status: 200 len: 1755 microversion: 2.1 time: 0.156594 Jun 07 09:45:07.225737 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 612/1225] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:45:07 2022] GET /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7 => generated 1755 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:45:08.242301 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-474d6fd5-8396-4462-b9ab-26aad5531e43 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:45:08.242918 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-474d6fd5-8396-4462-b9ab-26aad5531e43 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] [instance: 06e4dfcb-5449-443b-8fa1-e52fce36cda7] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:45:08.249382 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-474d6fd5-8396-4462-b9ab-26aad5531e43 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:45:08.249830 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-474d6fd5-8396-4462-b9ab-26aad5531e43 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:45:08.250582 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-474d6fd5-8396-4462-b9ab-26aad5531e43 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:45:08.251014 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-474d6fd5-8396-4462-b9ab-26aad5531e43 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:45:08.389310 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-474d6fd5-8396-4462-b9ab-26aad5531e43 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4658a11ae5b740e78c4ea8e656b46212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f7583c3efc45cb83a18d3c8f3f1cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:45:08.397134 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-474d6fd5-8396-4462-b9ab-26aad5531e43 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] 10.222.0.57 "GET /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7" status: 200 len: 1755 microversion: 2.1 time: 0.158672 Jun 07 09:45:08.397697 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 614/1226] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:45:08 2022] GET /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7 => generated 1755 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:45:09.415414 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-3570667c-b79d-49df-be87-38163bcfb84d tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:45:09.416018 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-3570667c-b79d-49df-be87-38163bcfb84d tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] [instance: 06e4dfcb-5449-443b-8fa1-e52fce36cda7] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:45:09.423070 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-3570667c-b79d-49df-be87-38163bcfb84d tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:45:09.423514 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-3570667c-b79d-49df-be87-38163bcfb84d tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:45:09.424269 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-3570667c-b79d-49df-be87-38163bcfb84d tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:45:09.424730 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-3570667c-b79d-49df-be87-38163bcfb84d tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:45:09.564995 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-3570667c-b79d-49df-be87-38163bcfb84d tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4658a11ae5b740e78c4ea8e656b46212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f7583c3efc45cb83a18d3c8f3f1cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:45:09.572900 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-3570667c-b79d-49df-be87-38163bcfb84d tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] 10.222.0.57 "GET /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7" status: 200 len: 1755 microversion: 2.1 time: 0.161273 Jun 07 09:45:09.573456 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 613/1227] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:45:09 2022] GET /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7 => generated 1755 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:45:10.589904 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-4936979f-e48a-4619-899d-f04cbf0b2dfe tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:45:10.590523 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-4936979f-e48a-4619-899d-f04cbf0b2dfe tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] [instance: 06e4dfcb-5449-443b-8fa1-e52fce36cda7] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:45:10.597205 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-4936979f-e48a-4619-899d-f04cbf0b2dfe tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:45:10.597654 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-4936979f-e48a-4619-899d-f04cbf0b2dfe tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:45:10.598419 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-4936979f-e48a-4619-899d-f04cbf0b2dfe tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:45:10.598856 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-4936979f-e48a-4619-899d-f04cbf0b2dfe tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:45:10.740518 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-4936979f-e48a-4619-899d-f04cbf0b2dfe tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4658a11ae5b740e78c4ea8e656b46212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f7583c3efc45cb83a18d3c8f3f1cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:45:10.749090 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-4936979f-e48a-4619-899d-f04cbf0b2dfe tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] 10.222.0.57 "GET /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7" status: 200 len: 1755 microversion: 2.1 time: 0.163145 Jun 07 09:45:10.749649 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 615/1228] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:45:10 2022] GET /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7 => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:45:11.214262 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 09:45:11.214768 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Tue Jun 7 09:45:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 09:45:11.766026 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-6bb950c8-f24e-4bb3-bb2f-ba24655b8245 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:45:11.766684 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-6bb950c8-f24e-4bb3-bb2f-ba24655b8245 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] [instance: 06e4dfcb-5449-443b-8fa1-e52fce36cda7] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:45:11.773164 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-6bb950c8-f24e-4bb3-bb2f-ba24655b8245 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:45:11.773616 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-6bb950c8-f24e-4bb3-bb2f-ba24655b8245 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:45:11.774385 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-6bb950c8-f24e-4bb3-bb2f-ba24655b8245 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:45:11.774849 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-6bb950c8-f24e-4bb3-bb2f-ba24655b8245 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:45:11.916646 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-6bb950c8-f24e-4bb3-bb2f-ba24655b8245 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4658a11ae5b740e78c4ea8e656b46212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f7583c3efc45cb83a18d3c8f3f1cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:45:11.925282 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-6bb950c8-f24e-4bb3-bb2f-ba24655b8245 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] 10.222.0.57 "GET /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7" status: 200 len: 1755 microversion: 2.1 time: 0.163086 Jun 07 09:45:11.925840 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 614/1229] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:45:11 2022] GET /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7 => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:45:12.941400 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-82853596-d9d1-4e0a-aaab-32c1e6c938e0 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:45:12.942042 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-82853596-d9d1-4e0a-aaab-32c1e6c938e0 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] [instance: 06e4dfcb-5449-443b-8fa1-e52fce36cda7] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:45:12.948571 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-82853596-d9d1-4e0a-aaab-32c1e6c938e0 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:45:12.949052 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-82853596-d9d1-4e0a-aaab-32c1e6c938e0 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:45:12.950310 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-82853596-d9d1-4e0a-aaab-32c1e6c938e0 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:45:12.950751 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-82853596-d9d1-4e0a-aaab-32c1e6c938e0 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:45:13.090486 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-82853596-d9d1-4e0a-aaab-32c1e6c938e0 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4658a11ae5b740e78c4ea8e656b46212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f7583c3efc45cb83a18d3c8f3f1cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:45:13.098661 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-82853596-d9d1-4e0a-aaab-32c1e6c938e0 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] 10.222.0.57 "GET /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7" status: 200 len: 1755 microversion: 2.1 time: 0.161142 Jun 07 09:45:13.099219 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 616/1230] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:45:12 2022] GET /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7 => generated 1755 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:45:14.115681 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-bc1f0cdb-b1ff-4dad-a37b-4d36730f4c02 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:45:14.116225 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-bc1f0cdb-b1ff-4dad-a37b-4d36730f4c02 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] [instance: 06e4dfcb-5449-443b-8fa1-e52fce36cda7] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:45:14.123603 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-bc1f0cdb-b1ff-4dad-a37b-4d36730f4c02 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:45:14.124056 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-bc1f0cdb-b1ff-4dad-a37b-4d36730f4c02 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:45:14.124852 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-bc1f0cdb-b1ff-4dad-a37b-4d36730f4c02 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:45:14.125294 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-bc1f0cdb-b1ff-4dad-a37b-4d36730f4c02 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:45:14.265392 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-bc1f0cdb-b1ff-4dad-a37b-4d36730f4c02 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4658a11ae5b740e78c4ea8e656b46212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f7583c3efc45cb83a18d3c8f3f1cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:45:14.273176 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-bc1f0cdb-b1ff-4dad-a37b-4d36730f4c02 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] 10.222.0.57 "GET /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7" status: 200 len: 1755 microversion: 2.1 time: 0.161538 Jun 07 09:45:14.273731 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 615/1231] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:45:14 2022] GET /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7 => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:45:15.290310 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-78b33ef7-82c4-448e-8533-96cb66d971d3 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:45:15.290958 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-78b33ef7-82c4-448e-8533-96cb66d971d3 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] [instance: 06e4dfcb-5449-443b-8fa1-e52fce36cda7] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:45:15.297267 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-78b33ef7-82c4-448e-8533-96cb66d971d3 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:45:15.297715 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-78b33ef7-82c4-448e-8533-96cb66d971d3 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:45:15.298468 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-78b33ef7-82c4-448e-8533-96cb66d971d3 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:45:15.298904 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-78b33ef7-82c4-448e-8533-96cb66d971d3 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:45:15.440955 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-78b33ef7-82c4-448e-8533-96cb66d971d3 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4658a11ae5b740e78c4ea8e656b46212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f7583c3efc45cb83a18d3c8f3f1cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:45:15.448789 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-78b33ef7-82c4-448e-8533-96cb66d971d3 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] 10.222.0.57 "GET /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7" status: 200 len: 1758 microversion: 2.1 time: 0.162397 Jun 07 09:45:15.449978 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 617/1232] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:45:15 2022] GET /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7 => generated 1758 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:46:15.169529 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writing DB stats nova_api:SELECT=12 {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:46:15.173196 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writing DB stats nova_cell1:SELECT=36 {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:46:15.174581 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-9b8eecf5-bda7-4f73-9a89-454107a06a66 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-221550235", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-259675010", "security_groups": [{"name": "tempest-secgroup-smoke-1705282998"}], "block_device_mapping_v2": [{"uuid": "69c77092-68ce-4e3d-9cd6-b84cfa4e2995", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b3a7cead-e268-4715-a95d-aacec80a9aad"}]}} {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:46:15.286955 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.network.neutron [None req-9b8eecf5-bda7-4f73-9a89-454107a06a66 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] validate_networks() for [('b3a7cead-e268-4715-a95d-aacec80a9aad', None, None, None, None, None)] {{(pid=118740) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 09:46:15.913881 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.virt.hardware [None req-9b8eecf5-bda7-4f73-9a89-454107a06a66 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Flavor limits 0:0:0 {{(pid=118740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 09:46:15.914330 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.virt.hardware [None req-9b8eecf5-bda7-4f73-9a89-454107a06a66 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Image limits 0:0:0 {{(pid=118740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 09:46:15.914803 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.virt.hardware [None req-9b8eecf5-bda7-4f73-9a89-454107a06a66 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Flavor pref 0:0:0 {{(pid=118740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 09:46:15.915212 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.virt.hardware [None req-9b8eecf5-bda7-4f73-9a89-454107a06a66 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Image pref 0:0:0 {{(pid=118740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 09:46:15.915632 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.virt.hardware [None req-9b8eecf5-bda7-4f73-9a89-454107a06a66 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 09:46:15.924494 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-9b8eecf5-bda7-4f73-9a89-454107a06a66 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:46:15.924974 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-9b8eecf5-bda7-4f73-9a89-454107a06a66 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:46:15.925898 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-9b8eecf5-bda7-4f73-9a89-454107a06a66 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:46:15.926340 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-9b8eecf5-bda7-4f73-9a89-454107a06a66 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:46:15.943876 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.quota [None req-9b8eecf5-bda7-4f73-9a89-454107a06a66 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Getting quotas for project 8c26e375cbb2421b8c8e34653f7d2f38. Resources: {'instances', 'cores', 'ram'} {{(pid=118740) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 09:46:15.947859 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.quota [None req-9b8eecf5-bda7-4f73-9a89-454107a06a66 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Getting quotas for user a446f2a301a04fa485094d7be5219a07 and project 8c26e375cbb2421b8c8e34653f7d2f38. Resources: {'instances', 'cores', 'ram'} {{(pid=118740) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 09:46:16.004957 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-9b8eecf5-bda7-4f73-9a89-454107a06a66 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Going to run 1 instances... {{(pid=118740) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 09:46:16.007041 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-9b8eecf5-bda7-4f73-9a89-454107a06a66 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] [instance: b949f907-3bf9-4016-8562-556909e7f1ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='69c77092-68ce-4e3d-9cd6-b84cfa4e2995',volume_size=None,volume_type=None)] {{(pid=118740) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 09:46:16.351436 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-9b8eecf5-bda7-4f73-9a89-454107a06a66 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.183508 Jun 07 09:46:16.352125 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 616/1233] 10.222.0.57 () {60 vars in 1146 bytes} [Tue Jun 7 09:46:15 2022] POST /compute/v2.1/servers => generated 406 bytes in 1185 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 09:46:16.360283 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writing DB stats nova_api:SELECT=14 {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:46:16.364128 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:46:16.365604 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-ed9caf67-0ba7-4788-93c7-a8c4f1844c38 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:46:16.366217 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-ed9caf67-0ba7-4788-93c7-a8c4f1844c38 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] [instance: b949f907-3bf9-4016-8562-556909e7f1ca] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:46:16.419016 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-ed9caf67-0ba7-4788-93c7-a8c4f1844c38 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a446f2a301a04fa485094d7be5219a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c26e375cbb2421b8c8e34653f7d2f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:46:16.425602 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-ed9caf67-0ba7-4788-93c7-a8c4f1844c38 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] 10.222.0.57 "GET /compute/v2.1/servers/b949f907-3bf9-4016-8562-556909e7f1ca" status: 200 len: 1093 microversion: 2.1 time: 0.067242 Jun 07 09:46:16.426798 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 618/1234] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:46:16 2022] GET /compute/v2.1/servers/b949f907-3bf9-4016-8562-556909e7f1ca => generated 1093 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:46:17.444175 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-f9af4d87-92bc-4fe4-a700-6573fe4368bc tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:46:17.444831 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-f9af4d87-92bc-4fe4-a700-6573fe4368bc tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] [instance: b949f907-3bf9-4016-8562-556909e7f1ca] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:46:17.451601 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-f9af4d87-92bc-4fe4-a700-6573fe4368bc tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:46:17.452051 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-f9af4d87-92bc-4fe4-a700-6573fe4368bc tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:46:17.452854 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-f9af4d87-92bc-4fe4-a700-6573fe4368bc tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:46:17.453298 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-f9af4d87-92bc-4fe4-a700-6573fe4368bc tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:46:17.513141 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-f9af4d87-92bc-4fe4-a700-6573fe4368bc tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a446f2a301a04fa485094d7be5219a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c26e375cbb2421b8c8e34653f7d2f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:46:17.521199 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-f9af4d87-92bc-4fe4-a700-6573fe4368bc tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] 10.222.0.57 "GET /compute/v2.1/servers/b949f907-3bf9-4016-8562-556909e7f1ca" status: 200 len: 1143 microversion: 2.1 time: 0.082022 Jun 07 09:46:17.521763 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 617/1235] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:46:17 2022] GET /compute/v2.1/servers/b949f907-3bf9-4016-8562-556909e7f1ca => generated 1143 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:46:18.539168 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-34c43f66-387f-4fc9-8d2a-ff5e29019e1c tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:46:18.539936 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-34c43f66-387f-4fc9-8d2a-ff5e29019e1c tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] [instance: b949f907-3bf9-4016-8562-556909e7f1ca] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:46:18.548050 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-34c43f66-387f-4fc9-8d2a-ff5e29019e1c tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:46:18.548366 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-34c43f66-387f-4fc9-8d2a-ff5e29019e1c tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:46:18.549447 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-34c43f66-387f-4fc9-8d2a-ff5e29019e1c tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:46:18.549947 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-34c43f66-387f-4fc9-8d2a-ff5e29019e1c tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:46:18.774830 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-34c43f66-387f-4fc9-8d2a-ff5e29019e1c tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a446f2a301a04fa485094d7be5219a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c26e375cbb2421b8c8e34653f7d2f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:46:18.782412 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-34c43f66-387f-4fc9-8d2a-ff5e29019e1c tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] 10.222.0.57 "GET /compute/v2.1/servers/b949f907-3bf9-4016-8562-556909e7f1ca" status: 200 len: 1209 microversion: 2.1 time: 0.248122 Jun 07 09:46:18.782967 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 619/1236] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:46:18 2022] GET /compute/v2.1/servers/b949f907-3bf9-4016-8562-556909e7f1ca => generated 1209 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:46:19.149117 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-0bd64958-96dc-4d41-b876-ba38571da250 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1887495003"}} {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:46:19.149805 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-0bd64958-96dc-4d41-b876-ba38571da250 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] [instance: 06e4dfcb-5449-443b-8fa1-e52fce36cda7] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:46:19.156740 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-0bd64958-96dc-4d41-b876-ba38571da250 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:46:19.157284 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-0bd64958-96dc-4d41-b876-ba38571da250 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:46:19.158096 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-0bd64958-96dc-4d41-b876-ba38571da250 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:46:19.158539 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-0bd64958-96dc-4d41-b876-ba38571da250 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:46:19.287897 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.network.security_group_api [None req-0bd64958-96dc-4d41-b876-ba38571da250 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Removing security group 822b41bf-ca68-4aa8-9740-d42cfd6d77e3 from port 7d0625d7-0de3-40be-af38-c06ed2b15941 Jun 07 09:46:19.751704 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-0bd64958-96dc-4d41-b876-ba38571da250 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] 10.222.0.57 "POST /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7/action" status: 202 len: 0 microversion: 2.1 time: 0.607267 Jun 07 09:46:19.754950 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 618/1237] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Jun 7 09:46:19 2022] POST /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7/action => generated 0 bytes in 609 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 09:46:19.772372 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [req-2148b30a-cc25-44a3-8954-ff7ff1798c0a req-c731fa1c-0ed4-4fc3-8268-1c3a88e44989 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06e4dfcb-5449-443b-8fa1-e52fce36cda7", "tag": "7d0625d7-0de3-40be-af38-c06ed2b15941"}]} {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:46:19.795284 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [req-2148b30a-cc25-44a3-8954-ff7ff1798c0a req-c731fa1c-0ed4-4fc3-8268-1c3a88e44989 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:46:19.795284 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [req-2148b30a-cc25-44a3-8954-ff7ff1798c0a req-c731fa1c-0ed4-4fc3-8268-1c3a88e44989 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:46:19.807608 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-461e9f54-4d53-4f34-978c-5eee26cbd030 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:46:19.809621 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-461e9f54-4d53-4f34-978c-5eee26cbd030 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] [instance: b949f907-3bf9-4016-8562-556909e7f1ca] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:46:19.824475 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-461e9f54-4d53-4f34-978c-5eee26cbd030 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:46:19.824475 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-461e9f54-4d53-4f34-978c-5eee26cbd030 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:46:19.824475 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-461e9f54-4d53-4f34-978c-5eee26cbd030 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:46:19.825970 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.compute.server_external_events [req-2148b30a-cc25-44a3-8954-ff7ff1798c0a req-c731fa1c-0ed4-4fc3-8268-1c3a88e44989 service nova] Creating event network-changed:7d0625d7-0de3-40be-af38-c06ed2b15941 for instance 06e4dfcb-5449-443b-8fa1-e52fce36cda7 on hv-cinder-83699 Jun 07 09:46:19.826261 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-461e9f54-4d53-4f34-978c-5eee26cbd030 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:46:19.838447 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [req-2148b30a-cc25-44a3-8954-ff7ff1798c0a req-c731fa1c-0ed4-4fc3-8268-1c3a88e44989 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074860 Jun 07 09:46:19.842822 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 620/1238] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Jun 7 09:46:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:46:20.153015 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-461e9f54-4d53-4f34-978c-5eee26cbd030 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a446f2a301a04fa485094d7be5219a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c26e375cbb2421b8c8e34653f7d2f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:46:20.167932 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-461e9f54-4d53-4f34-978c-5eee26cbd030 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] 10.222.0.57 "GET /compute/v2.1/servers/b949f907-3bf9-4016-8562-556909e7f1ca" status: 200 len: 1277 microversion: 2.1 time: 0.365798 Jun 07 09:46:20.168790 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 619/1239] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:46:19 2022] GET /compute/v2.1/servers/b949f907-3bf9-4016-8562-556909e7f1ca => generated 1277 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:46:20.777688 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [req-c28c972e-0bbb-47b4-bb6f-3aaedca81658 req-d38c674d-0d6d-4a16-9485-eb364d04abef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b949f907-3bf9-4016-8562-556909e7f1ca", "tag": "2c7403ec-2ce7-449c-a66c-672b768aea1a"}]} {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:46:20.791886 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [req-c28c972e-0bbb-47b4-bb6f-3aaedca81658 req-d38c674d-0d6d-4a16-9485-eb364d04abef service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:46:20.792942 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [req-c28c972e-0bbb-47b4-bb6f-3aaedca81658 req-d38c674d-0d6d-4a16-9485-eb364d04abef service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:46:20.807426 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.compute.server_external_events [req-c28c972e-0bbb-47b4-bb6f-3aaedca81658 req-d38c674d-0d6d-4a16-9485-eb364d04abef service nova] Creating event network-changed:2c7403ec-2ce7-449c-a66c-672b768aea1a for instance b949f907-3bf9-4016-8562-556909e7f1ca on hv-cinder-83699 Jun 07 09:46:20.813231 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [req-c28c972e-0bbb-47b4-bb6f-3aaedca81658 req-d38c674d-0d6d-4a16-9485-eb364d04abef service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125018 Jun 07 09:46:20.815012 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 621/1240] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Jun 7 09:46:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:46:21.184835 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-9970b827-10b9-4854-a3af-b230887eabdd tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:46:21.185463 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-9970b827-10b9-4854-a3af-b230887eabdd tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] [instance: b949f907-3bf9-4016-8562-556909e7f1ca] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:46:21.192612 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-9970b827-10b9-4854-a3af-b230887eabdd tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:46:21.193071 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-9970b827-10b9-4854-a3af-b230887eabdd tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:46:21.193838 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-9970b827-10b9-4854-a3af-b230887eabdd tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:46:21.194533 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-9970b827-10b9-4854-a3af-b230887eabdd tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:46:21.400930 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-9970b827-10b9-4854-a3af-b230887eabdd tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a446f2a301a04fa485094d7be5219a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c26e375cbb2421b8c8e34653f7d2f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:46:21.408383 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-9970b827-10b9-4854-a3af-b230887eabdd tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] 10.222.0.57 "GET /compute/v2.1/servers/b949f907-3bf9-4016-8562-556909e7f1ca" status: 200 len: 1265 microversion: 2.1 time: 0.227386 Jun 07 09:46:21.408987 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 620/1241] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:46:21 2022] GET /compute/v2.1/servers/b949f907-3bf9-4016-8562-556909e7f1ca => generated 1265 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:46:21.497003 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-56138196-264a-4b14-a165-31d63a48331a tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:46:21.497589 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-56138196-264a-4b14-a165-31d63a48331a tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] [instance: 06e4dfcb-5449-443b-8fa1-e52fce36cda7] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:46:21.504315 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-56138196-264a-4b14-a165-31d63a48331a tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:46:21.504798 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-56138196-264a-4b14-a165-31d63a48331a tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:46:21.505560 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-56138196-264a-4b14-a165-31d63a48331a tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:46:21.506065 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-56138196-264a-4b14-a165-31d63a48331a tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:46:21.588676 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.objects.instance [None req-56138196-264a-4b14-a165-31d63a48331a tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lazy-loading 'services' on Instance uuid 06e4dfcb-5449-443b-8fa1-e52fce36cda7 {{(pid=118741) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 09:46:21.761639 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-56138196-264a-4b14-a165-31d63a48331a tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] 10.222.0.57 "DELETE /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7/os-volume_attachments/a43ce64e-b213-4f7e-be06-927aa33949e8" status: 202 len: 0 microversion: 2.1 time: 0.268770 Jun 07 09:46:21.762229 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 622/1242] 10.222.0.57 () {58 vars in 1415 bytes} [Tue Jun 7 09:46:21 2022] DELETE /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7/os-volume_attachments/a43ce64e-b213-4f7e-be06-927aa33949e8 => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 09:46:21.770497 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-e0d4cb48-8613-4b16-b251-50992ee34c3d tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:46:21.771490 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-e0d4cb48-8613-4b16-b251-50992ee34c3d tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] [instance: 06e4dfcb-5449-443b-8fa1-e52fce36cda7] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:46:21.777444 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-e0d4cb48-8613-4b16-b251-50992ee34c3d tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:46:21.777892 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-e0d4cb48-8613-4b16-b251-50992ee34c3d tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:46:21.778653 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-e0d4cb48-8613-4b16-b251-50992ee34c3d tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:46:21.779094 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-e0d4cb48-8613-4b16-b251-50992ee34c3d tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:46:21.807896 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-e0d4cb48-8613-4b16-b251-50992ee34c3d tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] 10.222.0.57 "GET /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041384 Jun 07 09:46:21.808448 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 621/1243] 10.222.0.57 () {58 vars in 1301 bytes} [Tue Jun 7 09:46:21 2022] GET /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:46:21.856329 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [req-e98d318a-1be8-41b3-9436-ad7e8c8555d8 req-f6badfa0-b4e0-403b-b410-46fcbde97c40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06e4dfcb-5449-443b-8fa1-e52fce36cda7", "tag": "7d0625d7-0de3-40be-af38-c06ed2b15941"}]} {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:46:21.865036 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [req-e98d318a-1be8-41b3-9436-ad7e8c8555d8 req-f6badfa0-b4e0-403b-b410-46fcbde97c40 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:46:21.865471 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [req-e98d318a-1be8-41b3-9436-ad7e8c8555d8 req-f6badfa0-b4e0-403b-b410-46fcbde97c40 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:46:21.876072 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.compute.server_external_events [req-e98d318a-1be8-41b3-9436-ad7e8c8555d8 req-f6badfa0-b4e0-403b-b410-46fcbde97c40 service nova] Creating event network-changed:7d0625d7-0de3-40be-af38-c06ed2b15941 for instance 06e4dfcb-5449-443b-8fa1-e52fce36cda7 on hv-cinder-83699 Jun 07 09:46:21.880938 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [req-e98d318a-1be8-41b3-9436-ad7e8c8555d8 req-f6badfa0-b4e0-403b-b410-46fcbde97c40 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029037 Jun 07 09:46:21.881519 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 623/1244] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Jun 7 09:46:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:46:22.425341 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-3ff5521f-cf72-4928-9cbe-339a81c44a96 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:46:22.426206 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-3ff5521f-cf72-4928-9cbe-339a81c44a96 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] [instance: b949f907-3bf9-4016-8562-556909e7f1ca] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:46:22.432082 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-3ff5521f-cf72-4928-9cbe-339a81c44a96 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:46:22.432525 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-3ff5521f-cf72-4928-9cbe-339a81c44a96 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:46:22.433351 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-3ff5521f-cf72-4928-9cbe-339a81c44a96 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:46:22.433783 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-3ff5521f-cf72-4928-9cbe-339a81c44a96 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:46:22.571655 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-3ff5521f-cf72-4928-9cbe-339a81c44a96 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a446f2a301a04fa485094d7be5219a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c26e375cbb2421b8c8e34653f7d2f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:46:22.579429 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-3ff5521f-cf72-4928-9cbe-339a81c44a96 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] 10.222.0.57 "GET /compute/v2.1/servers/b949f907-3bf9-4016-8562-556909e7f1ca" status: 200 len: 1265 microversion: 2.1 time: 0.157986 Jun 07 09:46:22.579996 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 622/1245] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:46:22 2022] GET /compute/v2.1/servers/b949f907-3bf9-4016-8562-556909e7f1ca => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:46:22.820404 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-1392112e-bec7-4a9b-8ee1-076aa923ba5a tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:46:22.821472 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-1392112e-bec7-4a9b-8ee1-076aa923ba5a tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] [instance: 06e4dfcb-5449-443b-8fa1-e52fce36cda7] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:46:22.827866 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-1392112e-bec7-4a9b-8ee1-076aa923ba5a tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:46:22.828326 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-1392112e-bec7-4a9b-8ee1-076aa923ba5a tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:46:22.829122 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-1392112e-bec7-4a9b-8ee1-076aa923ba5a tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:46:22.829565 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-1392112e-bec7-4a9b-8ee1-076aa923ba5a tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:46:22.861290 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-1392112e-bec7-4a9b-8ee1-076aa923ba5a tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] 10.222.0.57 "GET /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045619 Jun 07 09:46:22.865791 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 624/1246] 10.222.0.57 () {58 vars in 1301 bytes} [Tue Jun 7 09:46:22 2022] GET /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:46:23.596479 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-911271a8-82a7-4105-aca5-5eb61294ae46 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:46:23.597234 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-911271a8-82a7-4105-aca5-5eb61294ae46 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] [instance: b949f907-3bf9-4016-8562-556909e7f1ca] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:46:23.604106 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-911271a8-82a7-4105-aca5-5eb61294ae46 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:46:23.604535 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-911271a8-82a7-4105-aca5-5eb61294ae46 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:46:23.605313 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-911271a8-82a7-4105-aca5-5eb61294ae46 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:46:23.605739 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-911271a8-82a7-4105-aca5-5eb61294ae46 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:46:23.732918 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-911271a8-82a7-4105-aca5-5eb61294ae46 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a446f2a301a04fa485094d7be5219a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c26e375cbb2421b8c8e34653f7d2f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:46:23.740310 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-911271a8-82a7-4105-aca5-5eb61294ae46 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] 10.222.0.57 "GET /compute/v2.1/servers/b949f907-3bf9-4016-8562-556909e7f1ca" status: 200 len: 1265 microversion: 2.1 time: 0.147704 Jun 07 09:46:23.741011 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 623/1247] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:46:23 2022] GET /compute/v2.1/servers/b949f907-3bf9-4016-8562-556909e7f1ca => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:46:23.872893 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-9f2065b4-37ad-49b5-96a0-b568cc83d85e tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:46:23.873750 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-9f2065b4-37ad-49b5-96a0-b568cc83d85e tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] [instance: 06e4dfcb-5449-443b-8fa1-e52fce36cda7] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:46:23.880217 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-9f2065b4-37ad-49b5-96a0-b568cc83d85e tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:46:23.880701 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-9f2065b4-37ad-49b5-96a0-b568cc83d85e tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:46:23.882032 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-9f2065b4-37ad-49b5-96a0-b568cc83d85e tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:46:23.882471 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-9f2065b4-37ad-49b5-96a0-b568cc83d85e tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:46:23.909879 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-9f2065b4-37ad-49b5-96a0-b568cc83d85e tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] 10.222.0.57 "GET /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041022 Jun 07 09:46:23.910443 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 625/1248] 10.222.0.57 () {58 vars in 1301 bytes} [Tue Jun 7 09:46:23 2022] GET /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 07 09:46:23.919845 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-f40cde18-c48c-49a3-ac45-a69869fa02ba tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:46:23.920336 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-f40cde18-c48c-49a3-ac45-a69869fa02ba tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] [instance: 06e4dfcb-5449-443b-8fa1-e52fce36cda7] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:46:23.926158 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-f40cde18-c48c-49a3-ac45-a69869fa02ba tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:46:23.926606 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-f40cde18-c48c-49a3-ac45-a69869fa02ba tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:46:23.927356 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-f40cde18-c48c-49a3-ac45-a69869fa02ba tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:46:23.928282 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-f40cde18-c48c-49a3-ac45-a69869fa02ba tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:46:24.000043 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.wsgi [None req-f40cde18-c48c-49a3-ac45-a69869fa02ba tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] HTTP exception thrown: Instance 06e4dfcb-5449-443b-8fa1-e52fce36cda7 is not attached to volume a43ce64e-b213-4f7e-be06-927aa33949e8 Jun 07 09:46:24.002429 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-f40cde18-c48c-49a3-ac45-a69869fa02ba tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Request method failure captured: Jun 07 09:46:24.002429 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: request: DELETE /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7/os-volume_attachments/a43ce64e-b213-4f7e-be06-927aa33949e8 HTTP/1.1 Jun 07 09:46:24.002429 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Accept: application/json Jun 07 09:46:24.002429 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Accept-Encoding: identity Jun 07 09:46:24.002429 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Connection: close Jun 07 09:46:24.002429 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Content-Length: 0 Jun 07 09:46:24.002429 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Content-Type: application/json Jun 07 09:46:24.002429 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Host: 10.222.0.57 Jun 07 09:46:24.002429 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Openstack-System-Scope: None Jun 07 09:46:24.002429 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: User-Agent: python-urllib3/1.26.9 Jun 07 09:46:24.002429 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Auth-Token: gAAAAABinx2wvkk9GzLx5gS-CWWQDa0jg7Ur-6yCihrfEIg8MzIbEm6xYS1lOdQPyXz1LsLuBO_4_Qc5NBThq-uu4lXQS3S80YNOdhY88JEvE2jD7W4Kxx2sM3oN0ojsH8VcVOAE26fl0YCNyEhsGW3k8-EknHqfOU4Y2ijN2ocMJlj0W3Gwd5Q Jun 07 09:46:24.002429 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Domain-Id: None Jun 07 09:46:24.002429 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Domain-Name: None Jun 07 09:46:24.002429 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Identity-Status: Confirmed Jun 07 09:46:24.002429 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Is-Admin-Project: True Jun 07 09:46:24.002429 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Domain-Id: default Jun 07 09:46:24.002429 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Domain-Name: Default Jun 07 09:46:24.002429 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Id: 17f7583c3efc45cb83a18d3c8f3f1cf6 Jun 07 09:46:24.002429 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Name: tempest-TestMinimumBasicScenario-1115506945 Jun 07 09:46:24.002429 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Role: reader,member Jun 07 09:46:24.002429 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Roles: reader,member Jun 07 09:46:24.004069 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/17f7583c3efc45cb83a18d3c8f3f1cf6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/17f7583c3efc45cb83a18d3c8f3f1cf6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_17f7583c3efc45cb83a18d3c8f3f1cf6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/17f7583c3efc45cb83a18d3c8f3f1cf6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 07 09:46:24.004069 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Tenant: tempest-TestMinimumBasicScenario-1115506945 Jun 07 09:46:24.004069 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Tenant-Id: 17f7583c3efc45cb83a18d3c8f3f1cf6 Jun 07 09:46:24.004069 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1115506945 Jun 07 09:46:24.004069 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User: tempest-TestMinimumBasicScenario-1115506945-project Jun 07 09:46:24.004069 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Domain-Id: default Jun 07 09:46:24.004069 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Domain-Name: Default Jun 07 09:46:24.004069 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Id: 4658a11ae5b740e78c4ea8e656b46212 Jun 07 09:46:24.004069 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Name: tempest-TestMinimumBasicScenario-1115506945-project Jun 07 09:46:24.004069 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: method: > Jun 07 09:46:24.004069 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: exception: Instance 06e4dfcb-5449-443b-8fa1-e52fce36cda7 is not attached to volume a43ce64e-b213-4f7e-be06-927aa33949e8 Jun 07 09:46:24.004961 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: action_args: {'server_id': '06e4dfcb-5449-443b-8fa1-e52fce36cda7', 'id': 'a43ce64e-b213-4f7e-be06-927aa33949e8'} Jun 07 09:46:24.004961 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 09:46:24.004961 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:46:24.004961 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 07 09:46:24.004961 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 07 09:46:24.004961 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 07 09:46:24.004961 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 07 09:46:24.004961 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 07 09:46:24.004961 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 07 09:46:24.004961 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id a43ce64e-b213-4f7e-be06-927aa33949e8. Jun 07 09:46:24.004961 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:46:24.004961 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:46:24.004961 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:46:24.004961 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:46:24.004961 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:46:24.004961 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:46:24.004961 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 09:46:24.004961 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 09:46:24.004961 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 09:46:24.007108 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 09:46:24.007108 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 07 09:46:24.007108 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 07 09:46:24.007108 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06e4dfcb-5449-443b-8fa1-e52fce36cda7 is not attached to volume a43ce64e-b213-4f7e-be06-927aa33949e8 Jun 07 09:46:24.007108 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:46:24.007108 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:46:24.007108 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:46:24.007108 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:46:24.007108 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:46:24.007108 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:46:24.007108 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 09:46:24.007108 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 09:46:24.007108 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06e4dfcb-5449-443b-8fa1-e52fce36cda7 is not attached to volume a43ce64e-b213-4f7e-be06-927aa33949e8 Jun 07 09:46:24.007108 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:46:24.007108 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-f40cde18-c48c-49a3-ac45-a69869fa02ba tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Returning 404 to user: Instance 06e4dfcb-5449-443b-8fa1-e52fce36cda7 is not attached to volume a43ce64e-b213-4f7e-be06-927aa33949e8 {{(pid=118740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 09:46:24.008310 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-f40cde18-c48c-49a3-ac45-a69869fa02ba tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] 10.222.0.57 "DELETE /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7/os-volume_attachments/a43ce64e-b213-4f7e-be06-927aa33949e8" status: 404 len: 154 microversion: 2.1 time: 0.087890 Jun 07 09:46:24.008310 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 624/1249] 10.222.0.57 () {58 vars in 1415 bytes} [Tue Jun 7 09:46:23 2022] DELETE /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7/os-volume_attachments/a43ce64e-b213-4f7e-be06-927aa33949e8 => generated 154 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 09:46:24.757276 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-f0f5d96e-f205-431d-9890-2ae7a1a2930d tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:46:24.757884 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-f0f5d96e-f205-431d-9890-2ae7a1a2930d tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] [instance: b949f907-3bf9-4016-8562-556909e7f1ca] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:46:24.763783 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-f0f5d96e-f205-431d-9890-2ae7a1a2930d tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:46:24.764227 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-f0f5d96e-f205-431d-9890-2ae7a1a2930d tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:46:24.765060 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-f0f5d96e-f205-431d-9890-2ae7a1a2930d tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:46:24.765474 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-f0f5d96e-f205-431d-9890-2ae7a1a2930d tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:46:24.902694 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-f0f5d96e-f205-431d-9890-2ae7a1a2930d tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a446f2a301a04fa485094d7be5219a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c26e375cbb2421b8c8e34653f7d2f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:46:24.910384 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-f0f5d96e-f205-431d-9890-2ae7a1a2930d tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] 10.222.0.57 "GET /compute/v2.1/servers/b949f907-3bf9-4016-8562-556909e7f1ca" status: 200 len: 1265 microversion: 2.1 time: 0.157156 Jun 07 09:46:24.911010 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 626/1250] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:46:24 2022] GET /compute/v2.1/servers/b949f907-3bf9-4016-8562-556909e7f1ca => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:46:25.265488 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-fff24351-c3c2-4203-90b6-757f8323c5a7 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:46:25.266040 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-fff24351-c3c2-4203-90b6-757f8323c5a7 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] [instance: 06e4dfcb-5449-443b-8fa1-e52fce36cda7] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:46:25.272950 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-fff24351-c3c2-4203-90b6-757f8323c5a7 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:46:25.273401 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-fff24351-c3c2-4203-90b6-757f8323c5a7 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:46:25.274165 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-fff24351-c3c2-4203-90b6-757f8323c5a7 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:46:25.274600 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-fff24351-c3c2-4203-90b6-757f8323c5a7 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:46:25.299543 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-fff24351-c3c2-4203-90b6-757f8323c5a7 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] [instance: 06e4dfcb-5449-443b-8fa1-e52fce36cda7] Going to try to terminate instance {{(pid=118740) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 09:46:25.647761 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-fff24351-c3c2-4203-90b6-757f8323c5a7 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] 10.222.0.57 "DELETE /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7" status: 204 len: 0 microversion: 2.1 time: 0.385160 Jun 07 09:46:25.648263 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 625/1251] 10.222.0.57 () {58 vars in 1238 bytes} [Tue Jun 7 09:46:25 2022] DELETE /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 09:46:25.656478 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-325885ad-e226-4dcb-bc91-8fb723b0c768 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:46:25.657152 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-325885ad-e226-4dcb-bc91-8fb723b0c768 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] [instance: 06e4dfcb-5449-443b-8fa1-e52fce36cda7] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:46:25.663996 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-325885ad-e226-4dcb-bc91-8fb723b0c768 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:46:25.664483 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-325885ad-e226-4dcb-bc91-8fb723b0c768 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:46:25.665268 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-325885ad-e226-4dcb-bc91-8fb723b0c768 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:46:25.665693 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-325885ad-e226-4dcb-bc91-8fb723b0c768 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:46:25.790578 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-325885ad-e226-4dcb-bc91-8fb723b0c768 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4658a11ae5b740e78c4ea8e656b46212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f7583c3efc45cb83a18d3c8f3f1cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:46:25.797972 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-325885ad-e226-4dcb-bc91-8fb723b0c768 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] 10.222.0.57 "GET /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7" status: 200 len: 1553 microversion: 2.1 time: 0.145406 Jun 07 09:46:25.798534 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 627/1252] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:46:25 2022] GET /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7 => generated 1553 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:46:25.928164 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-ce3992ca-f5dc-45d8-a691-6f72085d9893 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:46:25.928900 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-ce3992ca-f5dc-45d8-a691-6f72085d9893 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] [instance: b949f907-3bf9-4016-8562-556909e7f1ca] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:46:25.933915 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writing DB stats nova_cell0:SELECT=2 {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:46:25.935834 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-ce3992ca-f5dc-45d8-a691-6f72085d9893 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:46:25.936275 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-ce3992ca-f5dc-45d8-a691-6f72085d9893 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:46:25.937064 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-ce3992ca-f5dc-45d8-a691-6f72085d9893 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:46:25.937497 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-ce3992ca-f5dc-45d8-a691-6f72085d9893 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:46:25.955589 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writing DB stats nova_cell0:SELECT=6 {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:46:26.072330 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-ce3992ca-f5dc-45d8-a691-6f72085d9893 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a446f2a301a04fa485094d7be5219a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c26e375cbb2421b8c8e34653f7d2f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:46:26.079860 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-ce3992ca-f5dc-45d8-a691-6f72085d9893 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] 10.222.0.57 "GET /compute/v2.1/servers/b949f907-3bf9-4016-8562-556909e7f1ca" status: 200 len: 1265 microversion: 2.1 time: 0.156459 Jun 07 09:46:26.080420 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 626/1253] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:46:25 2022] GET /compute/v2.1/servers/b949f907-3bf9-4016-8562-556909e7f1ca => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:46:26.815144 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-e3ad70d5-5e3e-4ca2-b5f3-9f81df5b34fa tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:46:26.815711 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-e3ad70d5-5e3e-4ca2-b5f3-9f81df5b34fa tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] [instance: 06e4dfcb-5449-443b-8fa1-e52fce36cda7] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:46:26.818102 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writing DB stats nova_cell0:SELECT=2 {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:46:26.823508 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-e3ad70d5-5e3e-4ca2-b5f3-9f81df5b34fa tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:46:26.823953 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-e3ad70d5-5e3e-4ca2-b5f3-9f81df5b34fa tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:46:26.824739 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-e3ad70d5-5e3e-4ca2-b5f3-9f81df5b34fa tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:46:26.825209 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-e3ad70d5-5e3e-4ca2-b5f3-9f81df5b34fa tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:46:26.954217 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-e3ad70d5-5e3e-4ca2-b5f3-9f81df5b34fa tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4658a11ae5b740e78c4ea8e656b46212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f7583c3efc45cb83a18d3c8f3f1cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:46:26.961528 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-e3ad70d5-5e3e-4ca2-b5f3-9f81df5b34fa tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] 10.222.0.57 "GET /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7" status: 200 len: 1553 microversion: 2.1 time: 0.150335 Jun 07 09:46:26.962085 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 628/1254] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:46:26 2022] GET /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7 => generated 1553 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:46:27.096719 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-ac97942b-2172-4cc0-9670-4d4bc7b90e00 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:46:27.097321 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-ac97942b-2172-4cc0-9670-4d4bc7b90e00 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] [instance: b949f907-3bf9-4016-8562-556909e7f1ca] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:46:27.104224 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-ac97942b-2172-4cc0-9670-4d4bc7b90e00 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:46:27.104703 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-ac97942b-2172-4cc0-9670-4d4bc7b90e00 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:46:27.105452 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-ac97942b-2172-4cc0-9670-4d4bc7b90e00 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:46:27.105885 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-ac97942b-2172-4cc0-9670-4d4bc7b90e00 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:46:27.235719 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-ac97942b-2172-4cc0-9670-4d4bc7b90e00 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a446f2a301a04fa485094d7be5219a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c26e375cbb2421b8c8e34653f7d2f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:46:27.243168 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-ac97942b-2172-4cc0-9670-4d4bc7b90e00 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] 10.222.0.57 "GET /compute/v2.1/servers/b949f907-3bf9-4016-8562-556909e7f1ca" status: 200 len: 1265 microversion: 2.1 time: 0.150327 Jun 07 09:46:27.243726 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 627/1255] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:46:27 2022] GET /compute/v2.1/servers/b949f907-3bf9-4016-8562-556909e7f1ca => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:46:27.979067 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-68ef833e-83c9-4a5b-bb25-065ad852ea31 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:46:27.979705 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-68ef833e-83c9-4a5b-bb25-065ad852ea31 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] [instance: 06e4dfcb-5449-443b-8fa1-e52fce36cda7] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:46:27.986095 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-68ef833e-83c9-4a5b-bb25-065ad852ea31 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:46:27.986542 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-68ef833e-83c9-4a5b-bb25-065ad852ea31 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:46:27.987292 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-68ef833e-83c9-4a5b-bb25-065ad852ea31 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:46:27.987727 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-68ef833e-83c9-4a5b-bb25-065ad852ea31 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:46:28.113696 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-68ef833e-83c9-4a5b-bb25-065ad852ea31 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4658a11ae5b740e78c4ea8e656b46212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f7583c3efc45cb83a18d3c8f3f1cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:46:28.121690 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-68ef833e-83c9-4a5b-bb25-065ad852ea31 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] 10.222.0.57 "GET /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7" status: 200 len: 1553 microversion: 2.1 time: 0.146993 Jun 07 09:46:28.122244 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 629/1256] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:46:27 2022] GET /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7 => generated 1553 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:46:28.259814 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-c5e90897-e084-4754-bc1f-2928a2fbccb5 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:46:28.260427 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-c5e90897-e084-4754-bc1f-2928a2fbccb5 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] [instance: b949f907-3bf9-4016-8562-556909e7f1ca] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:46:28.266864 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-c5e90897-e084-4754-bc1f-2928a2fbccb5 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:46:28.267316 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-c5e90897-e084-4754-bc1f-2928a2fbccb5 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:46:28.268076 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-c5e90897-e084-4754-bc1f-2928a2fbccb5 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:46:28.268515 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-c5e90897-e084-4754-bc1f-2928a2fbccb5 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:46:28.397282 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-c5e90897-e084-4754-bc1f-2928a2fbccb5 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a446f2a301a04fa485094d7be5219a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c26e375cbb2421b8c8e34653f7d2f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:46:28.404604 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-c5e90897-e084-4754-bc1f-2928a2fbccb5 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] 10.222.0.57 "GET /compute/v2.1/servers/b949f907-3bf9-4016-8562-556909e7f1ca" status: 200 len: 1265 microversion: 2.1 time: 0.148599 Jun 07 09:46:28.405169 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 628/1257] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:46:28 2022] GET /compute/v2.1/servers/b949f907-3bf9-4016-8562-556909e7f1ca => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:46:29.139965 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-d0cb6a64-303c-47fd-b7af-72a625a750ee tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:46:29.140535 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-d0cb6a64-303c-47fd-b7af-72a625a750ee tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] [instance: 06e4dfcb-5449-443b-8fa1-e52fce36cda7] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:46:29.147830 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-d0cb6a64-303c-47fd-b7af-72a625a750ee tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:46:29.148285 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-d0cb6a64-303c-47fd-b7af-72a625a750ee tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:46:29.149083 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-d0cb6a64-303c-47fd-b7af-72a625a750ee tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:46:29.149526 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-d0cb6a64-303c-47fd-b7af-72a625a750ee tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:46:29.339858 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-d0cb6a64-303c-47fd-b7af-72a625a750ee tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4658a11ae5b740e78c4ea8e656b46212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f7583c3efc45cb83a18d3c8f3f1cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:46:29.339858 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-d0cb6a64-303c-47fd-b7af-72a625a750ee tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] 10.222.0.57 "GET /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7" status: 200 len: 1553 microversion: 2.1 time: 0.167313 Jun 07 09:46:29.339858 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 630/1258] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:46:29 2022] GET /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7 => generated 1553 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:46:29.341325 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [req-826c4c93-9942-4fc2-a51d-747a58e0433d req-e80a43f7-e4c2-47e3-a40f-9c43d66c7798 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06e4dfcb-5449-443b-8fa1-e52fce36cda7", "name": "network-vif-deleted", "tag": "7d0625d7-0de3-40be-af38-c06ed2b15941"}]} {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:46:29.341325 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [req-826c4c93-9942-4fc2-a51d-747a58e0433d req-e80a43f7-e4c2-47e3-a40f-9c43d66c7798 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:46:29.341325 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [req-826c4c93-9942-4fc2-a51d-747a58e0433d req-e80a43f7-e4c2-47e3-a40f-9c43d66c7798 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:46:29.348820 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.compute.server_external_events [req-826c4c93-9942-4fc2-a51d-747a58e0433d req-e80a43f7-e4c2-47e3-a40f-9c43d66c7798 service nova] Creating event network-vif-deleted:7d0625d7-0de3-40be-af38-c06ed2b15941 for instance 06e4dfcb-5449-443b-8fa1-e52fce36cda7 on hv-cinder-83699 Jun 07 09:46:29.353777 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [req-826c4c93-9942-4fc2-a51d-747a58e0433d req-e80a43f7-e4c2-47e3-a40f-9c43d66c7798 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028898 Jun 07 09:46:29.354347 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 629/1259] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Jun 7 09:46:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:46:29.422085 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-187fe5af-6a9a-4535-b706-c66a3e64e6e4 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:46:29.425225 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-187fe5af-6a9a-4535-b706-c66a3e64e6e4 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] [instance: b949f907-3bf9-4016-8562-556909e7f1ca] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:46:29.428703 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-187fe5af-6a9a-4535-b706-c66a3e64e6e4 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:46:29.429151 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-187fe5af-6a9a-4535-b706-c66a3e64e6e4 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:46:29.429912 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-187fe5af-6a9a-4535-b706-c66a3e64e6e4 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:46:29.430346 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-187fe5af-6a9a-4535-b706-c66a3e64e6e4 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:46:29.561485 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-187fe5af-6a9a-4535-b706-c66a3e64e6e4 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a446f2a301a04fa485094d7be5219a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c26e375cbb2421b8c8e34653f7d2f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:46:29.569954 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-187fe5af-6a9a-4535-b706-c66a3e64e6e4 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] 10.222.0.57 "GET /compute/v2.1/servers/b949f907-3bf9-4016-8562-556909e7f1ca" status: 200 len: 1265 microversion: 2.1 time: 0.151729 Jun 07 09:46:29.570524 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 631/1260] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:46:29 2022] GET /compute/v2.1/servers/b949f907-3bf9-4016-8562-556909e7f1ca => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:46:30.320603 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-16a25658-3bd2-4642-8ad9-10eb57a74d47 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:46:30.321312 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-16a25658-3bd2-4642-8ad9-10eb57a74d47 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] [instance: 06e4dfcb-5449-443b-8fa1-e52fce36cda7] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:46:30.327647 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-16a25658-3bd2-4642-8ad9-10eb57a74d47 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:46:30.329658 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-16a25658-3bd2-4642-8ad9-10eb57a74d47 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:46:30.329658 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-16a25658-3bd2-4642-8ad9-10eb57a74d47 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:46:30.329658 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-16a25658-3bd2-4642-8ad9-10eb57a74d47 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:46:30.360427 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-16a25658-3bd2-4642-8ad9-10eb57a74d47 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:46:30.361176 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-16a25658-3bd2-4642-8ad9-10eb57a74d47 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:46:30.361344 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.objects.instance [None req-16a25658-3bd2-4642-8ad9-10eb57a74d47 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lazy-loading 'fault' on Instance uuid 06e4dfcb-5449-443b-8fa1-e52fce36cda7 {{(pid=118740) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 09:46:30.405460 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-16a25658-3bd2-4642-8ad9-10eb57a74d47 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4658a11ae5b740e78c4ea8e656b46212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f7583c3efc45cb83a18d3c8f3f1cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:46:30.413346 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-16a25658-3bd2-4642-8ad9-10eb57a74d47 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] 10.222.0.57 "GET /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7" status: 200 len: 1348 microversion: 2.1 time: 0.097000 Jun 07 09:46:30.414627 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 630/1261] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:46:30 2022] GET /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7 => generated 1348 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:46:30.587541 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-2d1901e4-51f4-403e-8f03-4485feca11d6 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:46:30.588208 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-2d1901e4-51f4-403e-8f03-4485feca11d6 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] [instance: b949f907-3bf9-4016-8562-556909e7f1ca] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:46:30.594775 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-2d1901e4-51f4-403e-8f03-4485feca11d6 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:46:30.595217 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-2d1901e4-51f4-403e-8f03-4485feca11d6 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:46:30.595967 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-2d1901e4-51f4-403e-8f03-4485feca11d6 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:46:30.596399 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-2d1901e4-51f4-403e-8f03-4485feca11d6 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:46:30.727140 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-2d1901e4-51f4-403e-8f03-4485feca11d6 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a446f2a301a04fa485094d7be5219a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c26e375cbb2421b8c8e34653f7d2f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:46:30.734537 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-2d1901e4-51f4-403e-8f03-4485feca11d6 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] 10.222.0.57 "GET /compute/v2.1/servers/b949f907-3bf9-4016-8562-556909e7f1ca" status: 200 len: 1265 microversion: 2.1 time: 0.151433 Jun 07 09:46:30.735102 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 632/1262] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:46:30 2022] GET /compute/v2.1/servers/b949f907-3bf9-4016-8562-556909e7f1ca => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:46:31.431665 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-d3f1d5f4-199a-4256-8e0d-af16b07818d4 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:46:31.432288 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-d3f1d5f4-199a-4256-8e0d-af16b07818d4 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] [instance: 06e4dfcb-5449-443b-8fa1-e52fce36cda7] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:46:31.438831 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-d3f1d5f4-199a-4256-8e0d-af16b07818d4 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:46:31.439288 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-d3f1d5f4-199a-4256-8e0d-af16b07818d4 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:46:31.440049 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-d3f1d5f4-199a-4256-8e0d-af16b07818d4 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:46:31.440489 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-d3f1d5f4-199a-4256-8e0d-af16b07818d4 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:46:31.454283 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.wsgi [None req-d3f1d5f4-199a-4256-8e0d-af16b07818d4 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] HTTP exception thrown: Instance 06e4dfcb-5449-443b-8fa1-e52fce36cda7 could not be found. Jun 07 09:46:31.455866 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-d3f1d5f4-199a-4256-8e0d-af16b07818d4 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Request method failure captured: Jun 07 09:46:31.455866 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: request: GET /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7 HTTP/1.1 Jun 07 09:46:31.455866 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Accept: application/json Jun 07 09:46:31.455866 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Accept-Encoding: identity Jun 07 09:46:31.455866 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Connection: close Jun 07 09:46:31.455866 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Content-Length: 0 Jun 07 09:46:31.455866 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Content-Type: application/json Jun 07 09:46:31.455866 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Host: 10.222.0.57 Jun 07 09:46:31.455866 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Openstack-System-Scope: None Jun 07 09:46:31.455866 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: User-Agent: python-urllib3/1.26.9 Jun 07 09:46:31.455866 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Auth-Token: gAAAAABinx2wvkk9GzLx5gS-CWWQDa0jg7Ur-6yCihrfEIg8MzIbEm6xYS1lOdQPyXz1LsLuBO_4_Qc5NBThq-uu4lXQS3S80YNOdhY88JEvE2jD7W4Kxx2sM3oN0ojsH8VcVOAE26fl0YCNyEhsGW3k8-EknHqfOU4Y2ijN2ocMJlj0W3Gwd5Q Jun 07 09:46:31.455866 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Domain-Id: None Jun 07 09:46:31.455866 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Domain-Name: None Jun 07 09:46:31.455866 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Identity-Status: Confirmed Jun 07 09:46:31.455866 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Is-Admin-Project: True Jun 07 09:46:31.455866 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Domain-Id: default Jun 07 09:46:31.455866 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Domain-Name: Default Jun 07 09:46:31.455866 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Id: 17f7583c3efc45cb83a18d3c8f3f1cf6 Jun 07 09:46:31.455866 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Name: tempest-TestMinimumBasicScenario-1115506945 Jun 07 09:46:31.455866 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Role: reader,member Jun 07 09:46:31.455866 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Roles: reader,member Jun 07 09:46:31.457682 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/17f7583c3efc45cb83a18d3c8f3f1cf6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/17f7583c3efc45cb83a18d3c8f3f1cf6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_17f7583c3efc45cb83a18d3c8f3f1cf6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/17f7583c3efc45cb83a18d3c8f3f1cf6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 07 09:46:31.457682 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Tenant: tempest-TestMinimumBasicScenario-1115506945 Jun 07 09:46:31.457682 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Tenant-Id: 17f7583c3efc45cb83a18d3c8f3f1cf6 Jun 07 09:46:31.457682 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1115506945 Jun 07 09:46:31.457682 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User: tempest-TestMinimumBasicScenario-1115506945-project Jun 07 09:46:31.457682 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Domain-Id: default Jun 07 09:46:31.457682 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Domain-Name: Default Jun 07 09:46:31.457682 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Id: 4658a11ae5b740e78c4ea8e656b46212 Jun 07 09:46:31.457682 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Name: tempest-TestMinimumBasicScenario-1115506945-project Jun 07 09:46:31.457682 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: method: > Jun 07 09:46:31.457682 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: exception: Instance 06e4dfcb-5449-443b-8fa1-e52fce36cda7 could not be found. Jun 07 09:46:31.457682 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: action_args: {'id': '06e4dfcb-5449-443b-8fa1-e52fce36cda7'} Jun 07 09:46:31.458792 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 09:46:31.458792 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:46:31.458792 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 09:46:31.458792 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 09:46:31.458792 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 09:46:31.458792 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 09:46:31.458792 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 09:46:31.458792 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 09:46:31.458792 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 09:46:31.458792 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 09:46:31.458792 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06e4dfcb-5449-443b-8fa1-e52fce36cda7 could not be found. Jun 07 09:46:31.458792 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:46:31.458792 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:46:31.458792 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:46:31.458792 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:46:31.458792 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:46:31.458792 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:46:31.458792 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 09:46:31.458792 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 09:46:31.458792 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 09:46:31.460751 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 09:46:31.460751 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 09:46:31.460751 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 09:46:31.460751 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 09:46:31.460751 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 09:46:31.460751 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 09:46:31.460751 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 09:46:31.460751 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06e4dfcb-5449-443b-8fa1-e52fce36cda7 could not be found. Jun 07 09:46:31.460751 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:46:31.460751 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:46:31.460751 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:46:31.460751 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:46:31.460751 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:46:31.460751 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:46:31.460751 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 09:46:31.460751 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 09:46:31.460751 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06e4dfcb-5449-443b-8fa1-e52fce36cda7 could not be found. Jun 07 09:46:31.460751 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:46:31.462351 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-d3f1d5f4-199a-4256-8e0d-af16b07818d4 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Returning 404 to user: Instance 06e4dfcb-5449-443b-8fa1-e52fce36cda7 could not be found. {{(pid=118740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 09:46:31.462351 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-d3f1d5f4-199a-4256-8e0d-af16b07818d4 tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] 10.222.0.57 "GET /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7" status: 404 len: 111 microversion: 2.1 time: 0.030111 Jun 07 09:46:31.462351 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 631/1263] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:46:31 2022] GET /compute/v2.1/servers/06e4dfcb-5449-443b-8fa1-e52fce36cda7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 09:46:31.466139 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-7d7d1309-c4c1-4e3a-b14d-247db2ad860f tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] Calling method '.version_select at 0x7f5c978a9820>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:46:31.557711 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-7d7d1309-c4c1-4e3a-b14d-247db2ad860f tempest-TestMinimumBasicScenario-1115506945 tempest-TestMinimumBasicScenario-1115506945-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1812624265" status: 202 len: 0 microversion: 2.1 time: 0.095494 Jun 07 09:46:31.558289 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 633/1264] 10.222.0.57 () {58 vars in 1271 bytes} [Tue Jun 7 09:46:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1812624265 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 09:46:31.751298 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-321c4beb-442d-44ee-88cc-4e78ec17118e tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:46:31.752054 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-321c4beb-442d-44ee-88cc-4e78ec17118e tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] [instance: b949f907-3bf9-4016-8562-556909e7f1ca] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:46:31.759208 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-321c4beb-442d-44ee-88cc-4e78ec17118e tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:46:31.759665 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-321c4beb-442d-44ee-88cc-4e78ec17118e tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:46:31.760458 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-321c4beb-442d-44ee-88cc-4e78ec17118e tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:46:31.761036 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-321c4beb-442d-44ee-88cc-4e78ec17118e tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:46:31.819349 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [req-813057a2-d152-48d9-97db-af9ad1d8703c req-2c1cc7d3-d956-44da-a540-fa5ef19087a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b949f907-3bf9-4016-8562-556909e7f1ca", "name": "network-vif-plugged", "status": "completed", "tag": "2c7403ec-2ce7-449c-a66c-672b768aea1a"}]} {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:46:31.829489 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [req-813057a2-d152-48d9-97db-af9ad1d8703c req-2c1cc7d3-d956-44da-a540-fa5ef19087a0 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:46:31.829489 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [req-813057a2-d152-48d9-97db-af9ad1d8703c req-2c1cc7d3-d956-44da-a540-fa5ef19087a0 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:46:31.840559 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.compute.server_external_events [req-813057a2-d152-48d9-97db-af9ad1d8703c req-2c1cc7d3-d956-44da-a540-fa5ef19087a0 service nova] Creating event network-vif-plugged:2c7403ec-2ce7-449c-a66c-672b768aea1a for instance b949f907-3bf9-4016-8562-556909e7f1ca on hv-cinder-83699 Jun 07 09:46:31.845995 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [req-813057a2-d152-48d9-97db-af9ad1d8703c req-2c1cc7d3-d956-44da-a540-fa5ef19087a0 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092499 Jun 07 09:46:31.846738 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 634/1265] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Jun 7 09:46:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:46:31.910461 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-321c4beb-442d-44ee-88cc-4e78ec17118e tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a446f2a301a04fa485094d7be5219a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c26e375cbb2421b8c8e34653f7d2f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:46:31.914670 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:46:31.919182 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-321c4beb-442d-44ee-88cc-4e78ec17118e tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] 10.222.0.57 "GET /compute/v2.1/servers/b949f907-3bf9-4016-8562-556909e7f1ca" status: 200 len: 1265 microversion: 2.1 time: 0.171926 Jun 07 09:46:31.919826 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 632/1266] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:46:31 2022] GET /compute/v2.1/servers/b949f907-3bf9-4016-8562-556909e7f1ca => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:46:32.937261 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-414feeb0-54b2-4a7b-8fd6-a5d240704898 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:46:32.937964 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-414feeb0-54b2-4a7b-8fd6-a5d240704898 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] [instance: b949f907-3bf9-4016-8562-556909e7f1ca] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:46:32.944243 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-414feeb0-54b2-4a7b-8fd6-a5d240704898 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:46:32.944726 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-414feeb0-54b2-4a7b-8fd6-a5d240704898 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:46:32.946054 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-414feeb0-54b2-4a7b-8fd6-a5d240704898 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:46:32.946493 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-414feeb0-54b2-4a7b-8fd6-a5d240704898 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:46:33.083006 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-414feeb0-54b2-4a7b-8fd6-a5d240704898 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a446f2a301a04fa485094d7be5219a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c26e375cbb2421b8c8e34653f7d2f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:46:33.092472 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-414feeb0-54b2-4a7b-8fd6-a5d240704898 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] 10.222.0.57 "GET /compute/v2.1/servers/b949f907-3bf9-4016-8562-556909e7f1ca" status: 200 len: 1265 microversion: 2.1 time: 0.159924 Jun 07 09:46:33.093072 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 635/1267] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:46:32 2022] GET /compute/v2.1/servers/b949f907-3bf9-4016-8562-556909e7f1ca => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:46:34.109950 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-cb8c3524-c58f-4ca9-9b9a-f4e8fd276f20 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:46:34.110512 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-cb8c3524-c58f-4ca9-9b9a-f4e8fd276f20 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] [instance: b949f907-3bf9-4016-8562-556909e7f1ca] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:46:34.118104 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-cb8c3524-c58f-4ca9-9b9a-f4e8fd276f20 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:46:34.118546 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-cb8c3524-c58f-4ca9-9b9a-f4e8fd276f20 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:46:34.119306 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-cb8c3524-c58f-4ca9-9b9a-f4e8fd276f20 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:46:34.119737 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-cb8c3524-c58f-4ca9-9b9a-f4e8fd276f20 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:46:34.325998 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-cb8c3524-c58f-4ca9-9b9a-f4e8fd276f20 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a446f2a301a04fa485094d7be5219a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c26e375cbb2421b8c8e34653f7d2f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:46:34.334112 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-cb8c3524-c58f-4ca9-9b9a-f4e8fd276f20 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] 10.222.0.57 "GET /compute/v2.1/servers/b949f907-3bf9-4016-8562-556909e7f1ca" status: 200 len: 1451 microversion: 2.1 time: 0.228360 Jun 07 09:46:34.334683 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 633/1268] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:46:34 2022] GET /compute/v2.1/servers/b949f907-3bf9-4016-8562-556909e7f1ca => generated 1451 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:46:34.353424 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-7482a436-8089-4017-9ab8-3980fed149fb tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:46:34.354539 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-7482a436-8089-4017-9ab8-3980fed149fb tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] [instance: b949f907-3bf9-4016-8562-556909e7f1ca] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:46:34.360701 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-7482a436-8089-4017-9ab8-3980fed149fb tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:46:34.361337 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-7482a436-8089-4017-9ab8-3980fed149fb tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:46:34.362097 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-7482a436-8089-4017-9ab8-3980fed149fb tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:46:34.362522 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-7482a436-8089-4017-9ab8-3980fed149fb tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:46:34.604422 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-7482a436-8089-4017-9ab8-3980fed149fb tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a446f2a301a04fa485094d7be5219a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c26e375cbb2421b8c8e34653f7d2f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:46:34.613186 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-7482a436-8089-4017-9ab8-3980fed149fb tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] 10.222.0.57 "GET /compute/v2.1/servers/b949f907-3bf9-4016-8562-556909e7f1ca" status: 200 len: 1451 microversion: 2.1 time: 0.266268 Jun 07 09:46:34.614264 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 636/1269] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:46:34 2022] GET /compute/v2.1/servers/b949f907-3bf9-4016-8562-556909e7f1ca => generated 1451 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:46:37.757925 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [req-a6a3e25f-d4d3-4039-8094-7c7c4239dce7 req-484de043-5623-46af-834e-b3de323e90aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b949f907-3bf9-4016-8562-556909e7f1ca", "tag": "2c7403ec-2ce7-449c-a66c-672b768aea1a"}]} {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:46:37.767191 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [req-a6a3e25f-d4d3-4039-8094-7c7c4239dce7 req-484de043-5623-46af-834e-b3de323e90aa service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:46:37.767646 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [req-a6a3e25f-d4d3-4039-8094-7c7c4239dce7 req-484de043-5623-46af-834e-b3de323e90aa service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:46:37.779557 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.compute.server_external_events [req-a6a3e25f-d4d3-4039-8094-7c7c4239dce7 req-484de043-5623-46af-834e-b3de323e90aa service nova] Creating event network-changed:2c7403ec-2ce7-449c-a66c-672b768aea1a for instance b949f907-3bf9-4016-8562-556909e7f1ca on hv-cinder-83699 Jun 07 09:46:37.785174 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [req-a6a3e25f-d4d3-4039-8094-7c7c4239dce7 req-484de043-5623-46af-834e-b3de323e90aa service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030865 Jun 07 09:46:37.785746 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 634/1270] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Jun 7 09:46:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:46:44.179047 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 09:46:44.179579 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Tue Jun 7 09:46:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 09:48:27.302919 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1477bc13-f7ec-4bf2-96f5-9f3fe4966c5d] AMQP server on 10.222.0.57:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 07 09:48:27.303502 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:48:27.304252 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG dbcounter [-] [118740] Writing DB stats nova_cell1:SELECT=8 {{(pid=118740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:48:27.308547 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [req-46715c83-6ab2-49db-a77b-71df4a7ca7a7 req-b4159bf6-54ce-4043-b0ae-929f07779d8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b949f907-3bf9-4016-8562-556909e7f1ca", "tag": "2c7403ec-2ce7-449c-a66c-672b768aea1a"}]} {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:48:27.312108 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-29c10717-2579-4493-bd0e-1380818aaa56 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:48:27.312647 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-29c10717-2579-4493-bd0e-1380818aaa56 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] [instance: b949f907-3bf9-4016-8562-556909e7f1ca] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:48:27.315032 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writing DB stats nova_api:SELECT=41,nova_api:DELETE=1 {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:48:27.315885 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG dbcounter [-] [118741] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=1 {{(pid=118741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 09:48:27.320886 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-29c10717-2579-4493-bd0e-1380818aaa56 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:48:27.321577 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-29c10717-2579-4493-bd0e-1380818aaa56 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:48:27.322346 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-29c10717-2579-4493-bd0e-1380818aaa56 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:48:27.322783 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-29c10717-2579-4493-bd0e-1380818aaa56 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:48:27.322997 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [req-46715c83-6ab2-49db-a77b-71df4a7ca7a7 req-b4159bf6-54ce-4043-b0ae-929f07779d8c service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:48:27.323480 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [req-46715c83-6ab2-49db-a77b-71df4a7ca7a7 req-b4159bf6-54ce-4043-b0ae-929f07779d8c service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:48:27.335918 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.compute.server_external_events [req-46715c83-6ab2-49db-a77b-71df4a7ca7a7 req-b4159bf6-54ce-4043-b0ae-929f07779d8c service nova] Creating event network-changed:2c7403ec-2ce7-449c-a66c-672b768aea1a for instance b949f907-3bf9-4016-8562-556909e7f1ca on hv-cinder-83699 Jun 07 09:48:27.342452 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [req-46715c83-6ab2-49db-a77b-71df4a7ca7a7 req-b4159bf6-54ce-4043-b0ae-929f07779d8c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041381 Jun 07 09:48:27.343053 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 635/1271] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Jun 7 09:48:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:48:27.350344 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-29c10717-2579-4493-bd0e-1380818aaa56 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] [instance: b949f907-3bf9-4016-8562-556909e7f1ca] Going to try to terminate instance {{(pid=118741) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 09:48:27.643631 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-29c10717-2579-4493-bd0e-1380818aaa56 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] 10.222.0.57 "DELETE /compute/v2.1/servers/b949f907-3bf9-4016-8562-556909e7f1ca" status: 204 len: 0 microversion: 2.1 time: 0.344876 Jun 07 09:48:27.644662 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 637/1272] 10.222.0.57 () {58 vars in 1238 bytes} [Tue Jun 7 09:48:27 2022] DELETE /compute/v2.1/servers/b949f907-3bf9-4016-8562-556909e7f1ca => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 09:48:27.654564 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-1c5e9768-6999-45bb-9e71-7e21d492fafb tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:48:27.655397 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-1c5e9768-6999-45bb-9e71-7e21d492fafb tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] [instance: b949f907-3bf9-4016-8562-556909e7f1ca] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:48:27.663774 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-1c5e9768-6999-45bb-9e71-7e21d492fafb tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:48:27.664357 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-1c5e9768-6999-45bb-9e71-7e21d492fafb tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:48:27.665288 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-1c5e9768-6999-45bb-9e71-7e21d492fafb tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:48:27.665819 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-1c5e9768-6999-45bb-9e71-7e21d492fafb tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:48:27.802534 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-1c5e9768-6999-45bb-9e71-7e21d492fafb tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a446f2a301a04fa485094d7be5219a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c26e375cbb2421b8c8e34653f7d2f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:48:27.810690 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-1c5e9768-6999-45bb-9e71-7e21d492fafb tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] 10.222.0.57 "GET /compute/v2.1/servers/b949f907-3bf9-4016-8562-556909e7f1ca" status: 200 len: 1575 microversion: 2.1 time: 0.161781 Jun 07 09:48:27.811253 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 636/1273] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:48:27 2022] GET /compute/v2.1/servers/b949f907-3bf9-4016-8562-556909e7f1ca => generated 1575 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:48:28.829121 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-252b3913-da94-4d8b-9c3c-c1aed0523fe9 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:48:28.829818 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-252b3913-da94-4d8b-9c3c-c1aed0523fe9 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] [instance: b949f907-3bf9-4016-8562-556909e7f1ca] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:48:28.836064 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-252b3913-da94-4d8b-9c3c-c1aed0523fe9 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:48:28.836507 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-252b3913-da94-4d8b-9c3c-c1aed0523fe9 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:48:28.837288 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-252b3913-da94-4d8b-9c3c-c1aed0523fe9 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:48:28.837718 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-252b3913-da94-4d8b-9c3c-c1aed0523fe9 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:48:28.972741 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-252b3913-da94-4d8b-9c3c-c1aed0523fe9 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a446f2a301a04fa485094d7be5219a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c26e375cbb2421b8c8e34653f7d2f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:48:28.977053 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-252b3913-da94-4d8b-9c3c-c1aed0523fe9 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] 10.222.0.57 "GET /compute/v2.1/servers/b949f907-3bf9-4016-8562-556909e7f1ca" status: 200 len: 1575 microversion: 2.1 time: 0.152569 Jun 07 09:48:28.977699 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 638/1274] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:48:28 2022] GET /compute/v2.1/servers/b949f907-3bf9-4016-8562-556909e7f1ca => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:48:29.995509 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-53c6e043-3a29-4979-9a76-383c934bb4ab tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:48:29.996115 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-53c6e043-3a29-4979-9a76-383c934bb4ab tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] [instance: b949f907-3bf9-4016-8562-556909e7f1ca] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:48:30.003541 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-53c6e043-3a29-4979-9a76-383c934bb4ab tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:48:30.003987 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-53c6e043-3a29-4979-9a76-383c934bb4ab tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:48:30.004781 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-53c6e043-3a29-4979-9a76-383c934bb4ab tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:48:30.005215 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-53c6e043-3a29-4979-9a76-383c934bb4ab tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:48:30.021975 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO oslo.messaging._drivers.impl_rabbit [-] [1477bc13-f7ec-4bf2-96f5-9f3fe4966c5d] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 54738. Jun 07 09:48:30.346422 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [req-20a8f9e2-bd93-4131-9a7a-cf006c5f3925 req-038e1197-0805-40f5-992d-29e8e2feb01f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b949f907-3bf9-4016-8562-556909e7f1ca", "name": "network-vif-deleted", "tag": "2c7403ec-2ce7-449c-a66c-672b768aea1a"}]} {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:48:30.354774 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [req-20a8f9e2-bd93-4131-9a7a-cf006c5f3925 req-038e1197-0805-40f5-992d-29e8e2feb01f service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:48:30.357664 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [req-20a8f9e2-bd93-4131-9a7a-cf006c5f3925 req-038e1197-0805-40f5-992d-29e8e2feb01f service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:48:30.366219 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.compute.server_external_events [req-20a8f9e2-bd93-4131-9a7a-cf006c5f3925 req-038e1197-0805-40f5-992d-29e8e2feb01f service nova] Creating event network-vif-deleted:2c7403ec-2ce7-449c-a66c-672b768aea1a for instance b949f907-3bf9-4016-8562-556909e7f1ca on hv-cinder-83699 Jun 07 09:48:30.371382 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [req-20a8f9e2-bd93-4131-9a7a-cf006c5f3925 req-038e1197-0805-40f5-992d-29e8e2feb01f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028695 Jun 07 09:48:30.372551 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 639/1275] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Jun 7 09:48:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 09:48:30.374000 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-53c6e043-3a29-4979-9a76-383c934bb4ab tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a446f2a301a04fa485094d7be5219a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c26e375cbb2421b8c8e34653f7d2f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:48:30.381684 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-53c6e043-3a29-4979-9a76-383c934bb4ab tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] 10.222.0.57 "GET /compute/v2.1/servers/b949f907-3bf9-4016-8562-556909e7f1ca" status: 200 len: 1457 microversion: 2.1 time: 0.389987 Jun 07 09:48:30.382288 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 637/1276] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:48:29 2022] GET /compute/v2.1/servers/b949f907-3bf9-4016-8562-556909e7f1ca => generated 1457 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:48:31.223382 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 09:48:31.224019 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Tue Jun 7 09:48:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 09:48:31.399792 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-01104751-573c-4f84-afaa-bc1db941019c tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:48:31.400405 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-01104751-573c-4f84-afaa-bc1db941019c tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] [instance: b949f907-3bf9-4016-8562-556909e7f1ca] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:48:31.407730 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-01104751-573c-4f84-afaa-bc1db941019c tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:48:31.408181 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-01104751-573c-4f84-afaa-bc1db941019c tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:48:31.408978 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-01104751-573c-4f84-afaa-bc1db941019c tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:48:31.409412 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-01104751-573c-4f84-afaa-bc1db941019c tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:48:31.439002 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-01104751-573c-4f84-afaa-bc1db941019c tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:48:31.439447 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-01104751-573c-4f84-afaa-bc1db941019c tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:48:31.439889 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.objects.instance [None req-01104751-573c-4f84-afaa-bc1db941019c tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lazy-loading 'fault' on Instance uuid b949f907-3bf9-4016-8562-556909e7f1ca {{(pid=118741) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 09:48:31.534221 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-01104751-573c-4f84-afaa-bc1db941019c tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a446f2a301a04fa485094d7be5219a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c26e375cbb2421b8c8e34653f7d2f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:48:31.541775 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-01104751-573c-4f84-afaa-bc1db941019c tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] 10.222.0.57 "GET /compute/v2.1/servers/b949f907-3bf9-4016-8562-556909e7f1ca" status: 200 len: 1229 microversion: 2.1 time: 0.146254 Jun 07 09:48:31.542332 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 640/1277] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:48:31 2022] GET /compute/v2.1/servers/b949f907-3bf9-4016-8562-556909e7f1ca => generated 1229 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:48:32.558634 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-33ef814c-8e34-4e71-9586-bc0cc4f0c088 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:48:32.559245 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-33ef814c-8e34-4e71-9586-bc0cc4f0c088 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] [instance: b949f907-3bf9-4016-8562-556909e7f1ca] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:48:32.565710 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-33ef814c-8e34-4e71-9586-bc0cc4f0c088 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:48:32.566154 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-33ef814c-8e34-4e71-9586-bc0cc4f0c088 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:48:32.566909 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-33ef814c-8e34-4e71-9586-bc0cc4f0c088 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:48:32.567343 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-33ef814c-8e34-4e71-9586-bc0cc4f0c088 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:48:32.580165 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.wsgi [None req-33ef814c-8e34-4e71-9586-bc0cc4f0c088 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] HTTP exception thrown: Instance b949f907-3bf9-4016-8562-556909e7f1ca could not be found. Jun 07 09:48:32.581812 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-33ef814c-8e34-4e71-9586-bc0cc4f0c088 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Request method failure captured: Jun 07 09:48:32.581812 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: request: GET /compute/v2.1/servers/b949f907-3bf9-4016-8562-556909e7f1ca HTTP/1.1 Jun 07 09:48:32.581812 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Accept: application/json Jun 07 09:48:32.581812 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Accept-Encoding: identity Jun 07 09:48:32.581812 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Connection: close Jun 07 09:48:32.581812 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Content-Length: 0 Jun 07 09:48:32.581812 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Content-Type: application/json Jun 07 09:48:32.581812 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Host: 10.222.0.57 Jun 07 09:48:32.581812 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Openstack-System-Scope: None Jun 07 09:48:32.581812 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: User-Agent: python-urllib3/1.26.9 Jun 07 09:48:32.581812 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Auth-Token: gAAAAABinxzsDk7Tr2bhRcq_y4ijfKtEcxnIMVX4Vn0603GqFK0hTVKCqC3rd3N0YTH6PRRBDYeQRkqV5LoZcWzSAVfgOptpKFIYOUmAh5Y-ZZ8mf_rvxcMR2OzrItNFLjn6yGdH6j6rWHYcdFR4RXgzwq9giyQwZ8_Cnx_We1jh4IdHzaUqWDA Jun 07 09:48:32.581812 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Domain-Id: None Jun 07 09:48:32.581812 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Domain-Name: None Jun 07 09:48:32.581812 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Identity-Status: Confirmed Jun 07 09:48:32.581812 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Is-Admin-Project: True Jun 07 09:48:32.581812 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Domain-Id: default Jun 07 09:48:32.581812 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Domain-Name: Default Jun 07 09:48:32.581812 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Id: 8c26e375cbb2421b8c8e34653f7d2f38 Jun 07 09:48:32.581812 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Name: tempest-TestVolumeBootPattern-1188106385 Jun 07 09:48:32.581812 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Role: reader,member Jun 07 09:48:32.581812 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Roles: reader,member Jun 07 09:48:32.583633 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8c26e375cbb2421b8c8e34653f7d2f38"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/8c26e375cbb2421b8c8e34653f7d2f38"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_8c26e375cbb2421b8c8e34653f7d2f38"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8c26e375cbb2421b8c8e34653f7d2f38"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 07 09:48:32.583633 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Tenant: tempest-TestVolumeBootPattern-1188106385 Jun 07 09:48:32.583633 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Tenant-Id: 8c26e375cbb2421b8c8e34653f7d2f38 Jun 07 09:48:32.583633 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Tenant-Name: tempest-TestVolumeBootPattern-1188106385 Jun 07 09:48:32.583633 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User: tempest-TestVolumeBootPattern-1188106385-project Jun 07 09:48:32.583633 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Domain-Id: default Jun 07 09:48:32.583633 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Domain-Name: Default Jun 07 09:48:32.583633 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Id: a446f2a301a04fa485094d7be5219a07 Jun 07 09:48:32.583633 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Name: tempest-TestVolumeBootPattern-1188106385-project Jun 07 09:48:32.583633 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: method: > Jun 07 09:48:32.583633 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: exception: Instance b949f907-3bf9-4016-8562-556909e7f1ca could not be found. Jun 07 09:48:32.583633 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: action_args: {'id': 'b949f907-3bf9-4016-8562-556909e7f1ca'} Jun 07 09:48:32.584714 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 09:48:32.584714 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:48:32.584714 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 09:48:32.584714 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 09:48:32.584714 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 09:48:32.584714 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 09:48:32.584714 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 09:48:32.584714 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 09:48:32.584714 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 09:48:32.584714 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 09:48:32.584714 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b949f907-3bf9-4016-8562-556909e7f1ca could not be found. Jun 07 09:48:32.584714 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:48:32.584714 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:48:32.584714 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:48:32.584714 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:48:32.584714 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:48:32.584714 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:48:32.584714 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 09:48:32.584714 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 09:48:32.584714 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 09:48:32.586464 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 09:48:32.586464 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 09:48:32.586464 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 09:48:32.586464 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 09:48:32.586464 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 09:48:32.586464 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 09:48:32.586464 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 09:48:32.586464 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b949f907-3bf9-4016-8562-556909e7f1ca could not be found. Jun 07 09:48:32.586464 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:48:32.586464 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:48:32.586464 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:48:32.586464 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:48:32.586464 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:48:32.586464 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:48:32.586464 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 09:48:32.586464 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 09:48:32.586464 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b949f907-3bf9-4016-8562-556909e7f1ca could not be found. Jun 07 09:48:32.586464 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:48:32.587977 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-33ef814c-8e34-4e71-9586-bc0cc4f0c088 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Returning 404 to user: Instance b949f907-3bf9-4016-8562-556909e7f1ca could not be found. {{(pid=118740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 09:48:32.587977 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-33ef814c-8e34-4e71-9586-bc0cc4f0c088 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] 10.222.0.57 "GET /compute/v2.1/servers/b949f907-3bf9-4016-8562-556909e7f1ca" status: 404 len: 111 microversion: 2.1 time: 0.028362 Jun 07 09:48:32.587977 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 638/1278] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:48:32 2022] GET /compute/v2.1/servers/b949f907-3bf9-4016-8562-556909e7f1ca => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 09:48:36.101045 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-348610bd-b6c0-4b4f-8c81-8f9b1945b689 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:48:36.101579 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-348610bd-b6c0-4b4f-8c81-8f9b1945b689 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] [instance: 0cca2248-4ac0-4cad-ab8a-cbe43d6d670a] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:48:36.102948 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [req-11039df1-2ffc-470d-948f-f3490910692b req-6fb0dd52-cb7b-4455-beed-894d47e6c24a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cca2248-4ac0-4cad-ab8a-cbe43d6d670a", "tag": "ba1d289e-e5c1-44ac-a3db-cc25783eaf2f"}]} {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:48:36.108905 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-348610bd-b6c0-4b4f-8c81-8f9b1945b689 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:48:36.118486 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-348610bd-b6c0-4b4f-8c81-8f9b1945b689 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:48:36.118486 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-348610bd-b6c0-4b4f-8c81-8f9b1945b689 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:48:36.118486 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-348610bd-b6c0-4b4f-8c81-8f9b1945b689 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:48:36.118768 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [req-11039df1-2ffc-470d-948f-f3490910692b req-6fb0dd52-cb7b-4455-beed-894d47e6c24a service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:48:36.118768 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [req-11039df1-2ffc-470d-948f-f3490910692b req-6fb0dd52-cb7b-4455-beed-894d47e6c24a service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:48:36.125038 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.compute.server_external_events [req-11039df1-2ffc-470d-948f-f3490910692b req-6fb0dd52-cb7b-4455-beed-894d47e6c24a service nova] Creating event network-changed:ba1d289e-e5c1-44ac-a3db-cc25783eaf2f for instance 0cca2248-4ac0-4cad-ab8a-cbe43d6d670a on hv-cinder-83699 Jun 07 09:48:36.131033 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [req-11039df1-2ffc-470d-948f-f3490910692b req-6fb0dd52-cb7b-4455-beed-894d47e6c24a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031689 Jun 07 09:48:36.131662 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 639/1279] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Jun 7 09:48:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 09:48:36.138986 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-348610bd-b6c0-4b4f-8c81-8f9b1945b689 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] [instance: 0cca2248-4ac0-4cad-ab8a-cbe43d6d670a] Going to try to terminate instance {{(pid=118741) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 09:48:36.414327 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-348610bd-b6c0-4b4f-8c81-8f9b1945b689 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] 10.222.0.57 "DELETE /compute/v2.1/servers/0cca2248-4ac0-4cad-ab8a-cbe43d6d670a" status: 204 len: 0 microversion: 2.1 time: 0.316898 Jun 07 09:48:36.418999 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 641/1280] 10.222.0.57 () {58 vars in 1238 bytes} [Tue Jun 7 09:48:36 2022] DELETE /compute/v2.1/servers/0cca2248-4ac0-4cad-ab8a-cbe43d6d670a => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 09:48:36.426311 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-b6a8c97a-88cf-4c08-abae-8a0912f303fd tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:48:36.427299 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-b6a8c97a-88cf-4c08-abae-8a0912f303fd tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] [instance: 0cca2248-4ac0-4cad-ab8a-cbe43d6d670a] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:48:36.433639 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b6a8c97a-88cf-4c08-abae-8a0912f303fd tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:48:36.434237 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b6a8c97a-88cf-4c08-abae-8a0912f303fd tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:48:36.435086 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b6a8c97a-88cf-4c08-abae-8a0912f303fd tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:48:36.435755 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-b6a8c97a-88cf-4c08-abae-8a0912f303fd tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:48:36.569000 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-b6a8c97a-88cf-4c08-abae-8a0912f303fd tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a446f2a301a04fa485094d7be5219a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c26e375cbb2421b8c8e34653f7d2f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:48:36.577054 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-b6a8c97a-88cf-4c08-abae-8a0912f303fd tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] 10.222.0.57 "GET /compute/v2.1/servers/0cca2248-4ac0-4cad-ab8a-cbe43d6d670a" status: 200 len: 1577 microversion: 2.1 time: 0.155112 Jun 07 09:48:36.577621 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 640/1281] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:48:36 2022] GET /compute/v2.1/servers/0cca2248-4ac0-4cad-ab8a-cbe43d6d670a => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:48:37.596053 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-0ebae0c3-2014-4436-89cf-d2a0ba0ca5fd tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:48:37.597564 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-0ebae0c3-2014-4436-89cf-d2a0ba0ca5fd tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] [instance: 0cca2248-4ac0-4cad-ab8a-cbe43d6d670a] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:48:37.604640 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-0ebae0c3-2014-4436-89cf-d2a0ba0ca5fd tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:48:37.605135 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-0ebae0c3-2014-4436-89cf-d2a0ba0ca5fd tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:48:37.606480 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-0ebae0c3-2014-4436-89cf-d2a0ba0ca5fd tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:48:37.607058 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-0ebae0c3-2014-4436-89cf-d2a0ba0ca5fd tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:48:37.742428 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-0ebae0c3-2014-4436-89cf-d2a0ba0ca5fd tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a446f2a301a04fa485094d7be5219a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c26e375cbb2421b8c8e34653f7d2f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:48:37.750454 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-0ebae0c3-2014-4436-89cf-d2a0ba0ca5fd tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] 10.222.0.57 "GET /compute/v2.1/servers/0cca2248-4ac0-4cad-ab8a-cbe43d6d670a" status: 200 len: 1577 microversion: 2.1 time: 0.158867 Jun 07 09:48:37.751015 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 642/1282] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:48:37 2022] GET /compute/v2.1/servers/0cca2248-4ac0-4cad-ab8a-cbe43d6d670a => generated 1577 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:48:38.659794 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [req-401831b2-4770-40f2-8a26-3291acb7cfe7 req-c6c3a8c8-d61f-4dbf-8e4d-e23a16c564c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cca2248-4ac0-4cad-ab8a-cbe43d6d670a", "name": "network-vif-deleted", "tag": "ba1d289e-e5c1-44ac-a3db-cc25783eaf2f"}]} {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 09:48:38.668292 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [req-401831b2-4770-40f2-8a26-3291acb7cfe7 req-c6c3a8c8-d61f-4dbf-8e4d-e23a16c564c2 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:48:38.668781 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [req-401831b2-4770-40f2-8a26-3291acb7cfe7 req-c6c3a8c8-d61f-4dbf-8e4d-e23a16c564c2 service nova] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:48:38.679650 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.compute.server_external_events [req-401831b2-4770-40f2-8a26-3291acb7cfe7 req-c6c3a8c8-d61f-4dbf-8e4d-e23a16c564c2 service nova] Creating event network-vif-deleted:ba1d289e-e5c1-44ac-a3db-cc25783eaf2f for instance 0cca2248-4ac0-4cad-ab8a-cbe43d6d670a on hv-cinder-83699 Jun 07 09:48:38.684932 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [req-401831b2-4770-40f2-8a26-3291acb7cfe7 req-c6c3a8c8-d61f-4dbf-8e4d-e23a16c564c2 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028950 Jun 07 09:48:38.685526 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 641/1283] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Jun 7 09:48:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 09:48:38.768815 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-106ea7d8-83d9-4b9b-807e-97ad9f45d1f0 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:48:38.769418 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-106ea7d8-83d9-4b9b-807e-97ad9f45d1f0 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] [instance: 0cca2248-4ac0-4cad-ab8a-cbe43d6d670a] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:48:38.775797 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-106ea7d8-83d9-4b9b-807e-97ad9f45d1f0 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:48:38.776239 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-106ea7d8-83d9-4b9b-807e-97ad9f45d1f0 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:48:38.777012 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-106ea7d8-83d9-4b9b-807e-97ad9f45d1f0 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:48:38.777443 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-106ea7d8-83d9-4b9b-807e-97ad9f45d1f0 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:48:38.840133 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.policy [None req-106ea7d8-83d9-4b9b-807e-97ad9f45d1f0 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a446f2a301a04fa485094d7be5219a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c26e375cbb2421b8c8e34653f7d2f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118741) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:48:38.847649 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-106ea7d8-83d9-4b9b-807e-97ad9f45d1f0 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] 10.222.0.57 "GET /compute/v2.1/servers/0cca2248-4ac0-4cad-ab8a-cbe43d6d670a" status: 200 len: 1225 microversion: 2.1 time: 0.082842 Jun 07 09:48:38.848196 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 643/1284] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:48:38 2022] GET /compute/v2.1/servers/0cca2248-4ac0-4cad-ab8a-cbe43d6d670a => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:48:39.647499 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 09:48:39.647705 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Tue Jun 7 09:48:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 09:48:39.865909 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-45cf8aeb-5678-4cd3-9a8a-d9f324cc45c9 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:48:39.866617 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-45cf8aeb-5678-4cd3-9a8a-d9f324cc45c9 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] [instance: 0cca2248-4ac0-4cad-ab8a-cbe43d6d670a] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:48:39.872809 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-45cf8aeb-5678-4cd3-9a8a-d9f324cc45c9 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:48:39.873264 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-45cf8aeb-5678-4cd3-9a8a-d9f324cc45c9 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:48:39.874032 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-45cf8aeb-5678-4cd3-9a8a-d9f324cc45c9 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:48:39.874467 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-45cf8aeb-5678-4cd3-9a8a-d9f324cc45c9 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:48:39.905594 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-45cf8aeb-5678-4cd3-9a8a-d9f324cc45c9 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:48:39.905964 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-45cf8aeb-5678-4cd3-9a8a-d9f324cc45c9 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:48:39.906410 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.objects.instance [None req-45cf8aeb-5678-4cd3-9a8a-d9f324cc45c9 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lazy-loading 'fault' on Instance uuid 0cca2248-4ac0-4cad-ab8a-cbe43d6d670a {{(pid=118740) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 09:48:39.951094 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.policy [None req-45cf8aeb-5678-4cd3-9a8a-d9f324cc45c9 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a446f2a301a04fa485094d7be5219a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c26e375cbb2421b8c8e34653f7d2f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118740) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 09:48:39.958703 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-45cf8aeb-5678-4cd3-9a8a-d9f324cc45c9 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] 10.222.0.57 "GET /compute/v2.1/servers/0cca2248-4ac0-4cad-ab8a-cbe43d6d670a" status: 200 len: 1230 microversion: 2.1 time: 0.097500 Jun 07 09:48:39.959262 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 642/1285] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:48:39 2022] GET /compute/v2.1/servers/0cca2248-4ac0-4cad-ab8a-cbe43d6d670a => generated 1230 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 09:48:40.976414 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-510f37f7-8351-4281-a844-7624b5305dd2 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:48:40.977044 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-510f37f7-8351-4281-a844-7624b5305dd2 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] [instance: 0cca2248-4ac0-4cad-ab8a-cbe43d6d670a] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:48:40.983638 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-510f37f7-8351-4281-a844-7624b5305dd2 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:48:40.984079 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-510f37f7-8351-4281-a844-7624b5305dd2 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:48:40.984857 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-510f37f7-8351-4281-a844-7624b5305dd2 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:48:40.985287 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-510f37f7-8351-4281-a844-7624b5305dd2 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:48:40.998062 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.wsgi [None req-510f37f7-8351-4281-a844-7624b5305dd2 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] HTTP exception thrown: Instance 0cca2248-4ac0-4cad-ab8a-cbe43d6d670a could not be found. Jun 07 09:48:40.999682 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-510f37f7-8351-4281-a844-7624b5305dd2 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Request method failure captured: Jun 07 09:48:40.999682 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: request: GET /compute/v2.1/servers/0cca2248-4ac0-4cad-ab8a-cbe43d6d670a HTTP/1.1 Jun 07 09:48:40.999682 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Accept: application/json Jun 07 09:48:40.999682 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Accept-Encoding: identity Jun 07 09:48:40.999682 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Connection: close Jun 07 09:48:40.999682 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Content-Length: 0 Jun 07 09:48:40.999682 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Content-Type: application/json Jun 07 09:48:40.999682 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Host: 10.222.0.57 Jun 07 09:48:40.999682 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Openstack-System-Scope: None Jun 07 09:48:40.999682 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: User-Agent: python-urllib3/1.26.9 Jun 07 09:48:40.999682 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Auth-Token: gAAAAABinxzsDk7Tr2bhRcq_y4ijfKtEcxnIMVX4Vn0603GqFK0hTVKCqC3rd3N0YTH6PRRBDYeQRkqV5LoZcWzSAVfgOptpKFIYOUmAh5Y-ZZ8mf_rvxcMR2OzrItNFLjn6yGdH6j6rWHYcdFR4RXgzwq9giyQwZ8_Cnx_We1jh4IdHzaUqWDA Jun 07 09:48:40.999682 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Domain-Id: None Jun 07 09:48:40.999682 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Domain-Name: None Jun 07 09:48:40.999682 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Identity-Status: Confirmed Jun 07 09:48:40.999682 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Is-Admin-Project: True Jun 07 09:48:40.999682 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Project-Domain-Id: default Jun 07 09:48:40.999682 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Project-Domain-Name: Default Jun 07 09:48:40.999682 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Project-Id: 8c26e375cbb2421b8c8e34653f7d2f38 Jun 07 09:48:40.999682 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Project-Name: tempest-TestVolumeBootPattern-1188106385 Jun 07 09:48:40.999682 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Role: reader,member Jun 07 09:48:40.999682 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Roles: reader,member Jun 07 09:48:41.001469 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8c26e375cbb2421b8c8e34653f7d2f38"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/8c26e375cbb2421b8c8e34653f7d2f38"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_8c26e375cbb2421b8c8e34653f7d2f38"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8c26e375cbb2421b8c8e34653f7d2f38"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 07 09:48:41.001469 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Tenant: tempest-TestVolumeBootPattern-1188106385 Jun 07 09:48:41.001469 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Tenant-Id: 8c26e375cbb2421b8c8e34653f7d2f38 Jun 07 09:48:41.001469 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Tenant-Name: tempest-TestVolumeBootPattern-1188106385 Jun 07 09:48:41.001469 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User: tempest-TestVolumeBootPattern-1188106385-project Jun 07 09:48:41.001469 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User-Domain-Id: default Jun 07 09:48:41.001469 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User-Domain-Name: Default Jun 07 09:48:41.001469 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User-Id: a446f2a301a04fa485094d7be5219a07 Jun 07 09:48:41.001469 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User-Name: tempest-TestVolumeBootPattern-1188106385-project Jun 07 09:48:41.001469 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: method: > Jun 07 09:48:41.001469 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: exception: Instance 0cca2248-4ac0-4cad-ab8a-cbe43d6d670a could not be found. Jun 07 09:48:41.001469 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: action_args: {'id': '0cca2248-4ac0-4cad-ab8a-cbe43d6d670a'} Jun 07 09:48:41.002459 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 09:48:41.002459 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:48:41.002459 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 09:48:41.002459 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 09:48:41.002459 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 09:48:41.002459 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 09:48:41.002459 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 09:48:41.002459 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 09:48:41.002459 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 09:48:41.002459 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 09:48:41.002459 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cca2248-4ac0-4cad-ab8a-cbe43d6d670a could not be found. Jun 07 09:48:41.002459 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:48:41.002459 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:48:41.002459 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:48:41.002459 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:48:41.002459 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:48:41.002459 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:48:41.002459 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 09:48:41.002459 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 09:48:41.002459 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 09:48:41.004192 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 09:48:41.004192 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 09:48:41.004192 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 09:48:41.004192 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 09:48:41.004192 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 09:48:41.004192 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 09:48:41.004192 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 09:48:41.004192 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cca2248-4ac0-4cad-ab8a-cbe43d6d670a could not be found. Jun 07 09:48:41.004192 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:48:41.004192 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:48:41.004192 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:48:41.004192 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:48:41.004192 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:48:41.004192 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:48:41.004192 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 09:48:41.004192 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 09:48:41.004192 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cca2248-4ac0-4cad-ab8a-cbe43d6d670a could not be found. Jun 07 09:48:41.004192 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:48:41.006038 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-510f37f7-8351-4281-a844-7624b5305dd2 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Returning 404 to user: Instance 0cca2248-4ac0-4cad-ab8a-cbe43d6d670a could not be found. {{(pid=118741) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 09:48:41.006038 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-510f37f7-8351-4281-a844-7624b5305dd2 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] 10.222.0.57 "GET /compute/v2.1/servers/0cca2248-4ac0-4cad-ab8a-cbe43d6d670a" status: 404 len: 111 microversion: 2.1 time: 0.028640 Jun 07 09:48:41.006038 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 644/1286] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:48:40 2022] GET /compute/v2.1/servers/0cca2248-4ac0-4cad-ab8a-cbe43d6d670a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 09:48:41.499240 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-06a12dda-ed52-467c-ac27-abda88f5f370 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Calling method '>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:48:41.499739 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.compute.api [None req-06a12dda-ed52-467c-ac27-abda88f5f370 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] [instance: ce52be6b-b276-423b-8b23-c76ff0ae73ae] Fetching instance by UUID {{(pid=118740) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:48:41.506090 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-06a12dda-ed52-467c-ac27-abda88f5f370 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:48:41.506531 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-06a12dda-ed52-467c-ac27-abda88f5f370 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:48:41.507283 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-06a12dda-ed52-467c-ac27-abda88f5f370 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:48:41.507713 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG oslo_concurrency.lockutils [None req-06a12dda-ed52-467c-ac27-abda88f5f370 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:48:41.521181 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.wsgi [None req-06a12dda-ed52-467c-ac27-abda88f5f370 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] HTTP exception thrown: Instance ce52be6b-b276-423b-8b23-c76ff0ae73ae could not be found. Jun 07 09:48:41.522809 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-06a12dda-ed52-467c-ac27-abda88f5f370 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Request method failure captured: Jun 07 09:48:41.522809 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: request: DELETE /compute/v2.1/servers/ce52be6b-b276-423b-8b23-c76ff0ae73ae HTTP/1.1 Jun 07 09:48:41.522809 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Accept: application/json Jun 07 09:48:41.522809 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Accept-Encoding: identity Jun 07 09:48:41.522809 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Connection: close Jun 07 09:48:41.522809 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Content-Length: 0 Jun 07 09:48:41.522809 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Content-Type: application/json Jun 07 09:48:41.522809 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Host: 10.222.0.57 Jun 07 09:48:41.522809 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Openstack-System-Scope: None Jun 07 09:48:41.522809 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: User-Agent: python-urllib3/1.26.9 Jun 07 09:48:41.522809 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Auth-Token: gAAAAABinxzsDk7Tr2bhRcq_y4ijfKtEcxnIMVX4Vn0603GqFK0hTVKCqC3rd3N0YTH6PRRBDYeQRkqV5LoZcWzSAVfgOptpKFIYOUmAh5Y-ZZ8mf_rvxcMR2OzrItNFLjn6yGdH6j6rWHYcdFR4RXgzwq9giyQwZ8_Cnx_We1jh4IdHzaUqWDA Jun 07 09:48:41.522809 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Domain-Id: None Jun 07 09:48:41.522809 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Domain-Name: None Jun 07 09:48:41.522809 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Identity-Status: Confirmed Jun 07 09:48:41.522809 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Is-Admin-Project: True Jun 07 09:48:41.522809 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Domain-Id: default Jun 07 09:48:41.522809 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Domain-Name: Default Jun 07 09:48:41.522809 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Id: 8c26e375cbb2421b8c8e34653f7d2f38 Jun 07 09:48:41.522809 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Project-Name: tempest-TestVolumeBootPattern-1188106385 Jun 07 09:48:41.522809 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Role: reader,member Jun 07 09:48:41.522809 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Roles: reader,member Jun 07 09:48:41.524702 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8c26e375cbb2421b8c8e34653f7d2f38"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/8c26e375cbb2421b8c8e34653f7d2f38"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_8c26e375cbb2421b8c8e34653f7d2f38"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8c26e375cbb2421b8c8e34653f7d2f38"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 07 09:48:41.524702 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Tenant: tempest-TestVolumeBootPattern-1188106385 Jun 07 09:48:41.524702 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Tenant-Id: 8c26e375cbb2421b8c8e34653f7d2f38 Jun 07 09:48:41.524702 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-Tenant-Name: tempest-TestVolumeBootPattern-1188106385 Jun 07 09:48:41.524702 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User: tempest-TestVolumeBootPattern-1188106385-project Jun 07 09:48:41.524702 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Domain-Id: default Jun 07 09:48:41.524702 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Domain-Name: Default Jun 07 09:48:41.524702 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Id: a446f2a301a04fa485094d7be5219a07 Jun 07 09:48:41.524702 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: X-User-Name: tempest-TestVolumeBootPattern-1188106385-project Jun 07 09:48:41.524702 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: method: > Jun 07 09:48:41.524702 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: exception: Instance ce52be6b-b276-423b-8b23-c76ff0ae73ae could not be found. Jun 07 09:48:41.524702 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: action_args: {'id': 'ce52be6b-b276-423b-8b23-c76ff0ae73ae'} Jun 07 09:48:41.525903 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 09:48:41.525903 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:48:41.525903 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 09:48:41.525903 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 09:48:41.525903 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 09:48:41.525903 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 09:48:41.525903 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 09:48:41.525903 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 09:48:41.525903 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 09:48:41.525903 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 09:48:41.525903 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce52be6b-b276-423b-8b23-c76ff0ae73ae could not be found. Jun 07 09:48:41.525903 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:48:41.525903 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:48:41.525903 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:48:41.525903 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:48:41.525903 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:48:41.525903 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:48:41.525903 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 09:48:41.525903 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 09:48:41.525903 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 09:48:41.527627 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 09:48:41.527627 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 07 09:48:41.527627 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 07 09:48:41.527627 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 07 09:48:41.527627 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 07 09:48:41.527627 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 09:48:41.527627 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 09:48:41.527627 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 09:48:41.527627 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 09:48:41.527627 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce52be6b-b276-423b-8b23-c76ff0ae73ae could not be found. Jun 07 09:48:41.527627 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:48:41.527627 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:48:41.527627 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:48:41.527627 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:48:41.527627 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:48:41.527627 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:48:41.527627 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 09:48:41.527627 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 09:48:41.527627 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce52be6b-b276-423b-8b23-c76ff0ae73ae could not be found. Jun 07 09:48:41.527627 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: ERROR nova.api.openstack.wsgi Jun 07 09:48:41.529401 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-06a12dda-ed52-467c-ac27-abda88f5f370 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Returning 404 to user: Instance ce52be6b-b276-423b-8b23-c76ff0ae73ae could not be found. {{(pid=118740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 09:48:41.529401 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-06a12dda-ed52-467c-ac27-abda88f5f370 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] 10.222.0.57 "DELETE /compute/v2.1/servers/ce52be6b-b276-423b-8b23-c76ff0ae73ae" status: 404 len: 111 microversion: 2.1 time: 0.029324 Jun 07 09:48:41.529401 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 643/1287] 10.222.0.57 () {58 vars in 1238 bytes} [Tue Jun 7 09:48:41 2022] DELETE /compute/v2.1/servers/ce52be6b-b276-423b-8b23-c76ff0ae73ae => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 09:48:41.532792 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-3b0def86-5075-43cc-ba1c-3fe3c7189a51 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Calling method '>' {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:48:41.533406 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.compute.api [None req-3b0def86-5075-43cc-ba1c-3fe3c7189a51 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] [instance: ce52be6b-b276-423b-8b23-c76ff0ae73ae] Fetching instance by UUID {{(pid=118741) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 09:48:41.539701 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-3b0def86-5075-43cc-ba1c-3fe3c7189a51 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:48:41.540152 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-3b0def86-5075-43cc-ba1c-3fe3c7189a51 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:48:41.540940 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-3b0def86-5075-43cc-ba1c-3fe3c7189a51 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 09:48:41.541379 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG oslo_concurrency.lockutils [None req-3b0def86-5075-43cc-ba1c-3fe3c7189a51 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Lock "10588278-77f2-4e92-84e1-e5f9671c3564" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118741) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 09:48:41.554598 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.wsgi [None req-3b0def86-5075-43cc-ba1c-3fe3c7189a51 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] HTTP exception thrown: Instance ce52be6b-b276-423b-8b23-c76ff0ae73ae could not be found. Jun 07 09:48:41.556108 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-3b0def86-5075-43cc-ba1c-3fe3c7189a51 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Request method failure captured: Jun 07 09:48:41.556108 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: request: GET /compute/v2.1/servers/ce52be6b-b276-423b-8b23-c76ff0ae73ae HTTP/1.1 Jun 07 09:48:41.556108 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Accept: application/json Jun 07 09:48:41.556108 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Accept-Encoding: identity Jun 07 09:48:41.556108 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Connection: close Jun 07 09:48:41.556108 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Content-Length: 0 Jun 07 09:48:41.556108 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Content-Type: application/json Jun 07 09:48:41.556108 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Host: 10.222.0.57 Jun 07 09:48:41.556108 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Openstack-System-Scope: None Jun 07 09:48:41.556108 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: User-Agent: python-urllib3/1.26.9 Jun 07 09:48:41.556108 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Auth-Token: gAAAAABinxzsDk7Tr2bhRcq_y4ijfKtEcxnIMVX4Vn0603GqFK0hTVKCqC3rd3N0YTH6PRRBDYeQRkqV5LoZcWzSAVfgOptpKFIYOUmAh5Y-ZZ8mf_rvxcMR2OzrItNFLjn6yGdH6j6rWHYcdFR4RXgzwq9giyQwZ8_Cnx_We1jh4IdHzaUqWDA Jun 07 09:48:41.556108 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Domain-Id: None Jun 07 09:48:41.556108 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Domain-Name: None Jun 07 09:48:41.556108 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Identity-Status: Confirmed Jun 07 09:48:41.556108 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Is-Admin-Project: True Jun 07 09:48:41.556108 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Project-Domain-Id: default Jun 07 09:48:41.556108 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Project-Domain-Name: Default Jun 07 09:48:41.556108 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Project-Id: 8c26e375cbb2421b8c8e34653f7d2f38 Jun 07 09:48:41.556108 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Project-Name: tempest-TestVolumeBootPattern-1188106385 Jun 07 09:48:41.556108 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Role: reader,member Jun 07 09:48:41.556108 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Roles: reader,member Jun 07 09:48:41.558135 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8c26e375cbb2421b8c8e34653f7d2f38"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/8c26e375cbb2421b8c8e34653f7d2f38"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_8c26e375cbb2421b8c8e34653f7d2f38"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8c26e375cbb2421b8c8e34653f7d2f38"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 07 09:48:41.558135 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Tenant: tempest-TestVolumeBootPattern-1188106385 Jun 07 09:48:41.558135 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Tenant-Id: 8c26e375cbb2421b8c8e34653f7d2f38 Jun 07 09:48:41.558135 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-Tenant-Name: tempest-TestVolumeBootPattern-1188106385 Jun 07 09:48:41.558135 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User: tempest-TestVolumeBootPattern-1188106385-project Jun 07 09:48:41.558135 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User-Domain-Id: default Jun 07 09:48:41.558135 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User-Domain-Name: Default Jun 07 09:48:41.558135 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User-Id: a446f2a301a04fa485094d7be5219a07 Jun 07 09:48:41.558135 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: X-User-Name: tempest-TestVolumeBootPattern-1188106385-project Jun 07 09:48:41.558135 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: method: > Jun 07 09:48:41.558135 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: exception: Instance ce52be6b-b276-423b-8b23-c76ff0ae73ae could not be found. Jun 07 09:48:41.558135 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: action_args: {'id': 'ce52be6b-b276-423b-8b23-c76ff0ae73ae'} Jun 07 09:48:41.559706 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: {{(pid=118741) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 09:48:41.559706 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:48:41.559706 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 09:48:41.559706 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 09:48:41.559706 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 09:48:41.559706 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 09:48:41.559706 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 09:48:41.559706 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 09:48:41.559706 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 09:48:41.559706 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 09:48:41.559706 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce52be6b-b276-423b-8b23-c76ff0ae73ae could not be found. Jun 07 09:48:41.559706 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:48:41.559706 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:48:41.559706 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:48:41.559706 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:48:41.559706 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:48:41.559706 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:48:41.559706 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 09:48:41.559706 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 09:48:41.559706 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 09:48:41.561426 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 09:48:41.561426 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 09:48:41.561426 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 09:48:41.561426 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 09:48:41.561426 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 09:48:41.561426 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 09:48:41.561426 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 09:48:41.561426 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce52be6b-b276-423b-8b23-c76ff0ae73ae could not be found. Jun 07 09:48:41.561426 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:48:41.561426 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 09:48:41.561426 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:48:41.561426 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 09:48:41.561426 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 09:48:41.561426 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 09:48:41.561426 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 09:48:41.561426 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 09:48:41.561426 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce52be6b-b276-423b-8b23-c76ff0ae73ae could not be found. Jun 07 09:48:41.561426 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: ERROR nova.api.openstack.wsgi Jun 07 09:48:41.562942 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: DEBUG nova.api.openstack.wsgi [None req-3b0def86-5075-43cc-ba1c-3fe3c7189a51 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Returning 404 to user: Instance ce52be6b-b276-423b-8b23-c76ff0ae73ae could not be found. {{(pid=118741) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 09:48:41.562942 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO nova.api.openstack.requestlog [None req-3b0def86-5075-43cc-ba1c-3fe3c7189a51 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] 10.222.0.57 "GET /compute/v2.1/servers/ce52be6b-b276-423b-8b23-c76ff0ae73ae" status: 404 len: 111 microversion: 2.1 time: 0.028568 Jun 07 09:48:41.562942 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: [pid: 118741|app: 0|req: 645/1288] 10.222.0.57 () {58 vars in 1235 bytes} [Tue Jun 7 09:48:41 2022] GET /compute/v2.1/servers/ce52be6b-b276-423b-8b23-c76ff0ae73ae => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 09:48:43.033069 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: DEBUG nova.api.openstack.wsgi [None req-f0f8d469-2fe9-40ae-9bc7-bbff4e49b871 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] Calling method '.version_select at 0x7f5c91b88a60>' {{(pid=118740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 09:48:43.111668 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO nova.api.openstack.requestlog [None req-f0f8d469-2fe9-40ae-9bc7-bbff4e49b871 tempest-TestVolumeBootPattern-1188106385 tempest-TestVolumeBootPattern-1188106385-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-259675010" status: 202 len: 0 microversion: 2.1 time: 0.082567 Jun 07 09:48:43.112272 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: [pid: 118740|app: 0|req: 644/1289] 10.222.0.57 () {58 vars in 1259 bytes} [Tue Jun 7 09:48:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-259675010 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 09:48:46.754065 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 09:48:46.754770 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Tue Jun 7 09:48:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 09:50:04.187460 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 09:50:04.187979 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Tue Jun 7 09:50:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 09:51:51.231844 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 09:51:51.232426 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Tue Jun 7 09:51:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 09:51:59.656209 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 09:51:59.656856 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Tue Jun 7 09:51:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 09:52:06.764946 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 09:52:06.765511 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Tue Jun 7 09:52:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 09:53:24.196013 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 09:53:24.196606 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Tue Jun 7 09:53:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 09:53:48.423233 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 09:53:48.423812 dv-cinder-836996-31-iscsi devstack@n-api.service[118740]: Tue Jun 7 09:53:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 09:53:54.618972 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 09:53:54.619554 dv-cinder-836996-31-iscsi devstack@n-api.service[118741]: Tue Jun 7 09:53:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!